-- Logs begin at Mon 2022-06-06 09:56:22 UTC, end at Mon 2022-06-06 10:59:04 UTC. -- Jun 06 10:29:09.184189 dv-cinder-844822-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jun 06 10:29:09.193241 dv-cinder-844822-1-iscsi devstack@n-api.service[103359]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 06 10:29:09.195317 dv-cinder-844822-1-iscsi devstack@n-api.service[103359]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Jun 6 10:29:09 2022] *** Jun 06 10:29:09.195317 dv-cinder-844822-1-iscsi devstack@n-api.service[103359]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 06 10:29:09.195317 dv-cinder-844822-1-iscsi devstack@n-api.service[103359]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 06 10:29:09.195317 dv-cinder-844822-1-iscsi devstack@n-api.service[103359]: nodename: dv-cinder-844822-1-iscsi Jun 06 10:29:09.195317 dv-cinder-844822-1-iscsi devstack@n-api.service[103359]: machine: x86_64 Jun 06 10:29:09.195317 dv-cinder-844822-1-iscsi devstack@n-api.service[103359]: clock source: unix Jun 06 10:29:09.195317 dv-cinder-844822-1-iscsi devstack@n-api.service[103359]: pcre jit disabled Jun 06 10:29:09.195317 dv-cinder-844822-1-iscsi devstack@n-api.service[103359]: detected number of CPU cores: 4 Jun 06 10:29:09.195317 dv-cinder-844822-1-iscsi devstack@n-api.service[103359]: current working directory: / Jun 06 10:29:09.195317 dv-cinder-844822-1-iscsi devstack@n-api.service[103359]: detected binary path: /usr/bin/uwsgi-core Jun 06 10:29:09.195999 dv-cinder-844822-1-iscsi devstack@n-api.service[103359]: your processes number limit is 47680 Jun 06 10:29:09.195999 dv-cinder-844822-1-iscsi devstack@n-api.service[103359]: your memory page size is 4096 bytes Jun 06 10:29:09.195999 dv-cinder-844822-1-iscsi devstack@n-api.service[103359]: detected max file descriptor number: 2048 Jun 06 10:29:09.195999 dv-cinder-844822-1-iscsi devstack@n-api.service[103359]: lock engine: pthread robust mutexes Jun 06 10:29:09.195999 dv-cinder-844822-1-iscsi devstack@n-api.service[103359]: thunder lock: enabled Jun 06 10:29:09.195999 dv-cinder-844822-1-iscsi devstack@n-api.service[103359]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 06 10:29:09.195999 dv-cinder-844822-1-iscsi devstack@n-api.service[103359]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 06 10:29:09.240374 dv-cinder-844822-1-iscsi devstack@n-api.service[103359]: Python main interpreter initialized at 0x55e312de79c0 Jun 06 10:29:09.240374 dv-cinder-844822-1-iscsi devstack@n-api.service[103359]: python threads support enabled Jun 06 10:29:09.240374 dv-cinder-844822-1-iscsi devstack@n-api.service[103359]: your server socket listen backlog is limited to 100 connections Jun 06 10:29:09.240374 dv-cinder-844822-1-iscsi devstack@n-api.service[103359]: your mercy for graceful operations on workers is 90 seconds Jun 06 10:29:09.240778 dv-cinder-844822-1-iscsi devstack@n-api.service[103359]: mapped 403077 bytes (393 KB) for 2 cores Jun 06 10:29:09.240778 dv-cinder-844822-1-iscsi devstack@n-api.service[103359]: *** Operational MODE: preforking *** Jun 06 10:29:09.241035 dv-cinder-844822-1-iscsi devstack@n-api.service[103359]: *** uWSGI is running in multiple interpreter mode *** Jun 06 10:29:09.241035 dv-cinder-844822-1-iscsi devstack@n-api.service[103359]: spawned uWSGI master process (pid: 103359) Jun 06 10:29:09.241220 dv-cinder-844822-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jun 06 10:29:09.242304 dv-cinder-844822-1-iscsi devstack@n-api.service[103359]: spawned uWSGI worker 1 (pid: 103360, cores: 1) Jun 06 10:29:09.242304 dv-cinder-844822-1-iscsi devstack@n-api.service[103359]: spawned uWSGI worker 2 (pid: 103361, cores: 1) Jun 06 10:29:09.242304 dv-cinder-844822-1-iscsi devstack@n-api.service[103359]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 06 10:29:10.463907 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 06 10:29:10.485591 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 06 10:29:11.180891 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 06 10:29:11.180891 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: from cryptography.utils import int_from_bytes Jun 06 10:29:11.181536 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 06 10:29:11.181536 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: from cryptography.utils import int_from_bytes Jun 06 10:29:11.186426 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 06 10:29:11.186426 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: from cryptography.utils import int_from_bytes Jun 06 10:29:11.186757 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 06 10:29:11.186757 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: from cryptography.utils import int_from_bytes Jun 06 10:29:13.748140 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 06 10:29:13.748810 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 06 10:29:13.748904 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 06 10:29:13.749238 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 06 10:29:13.749487 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 06 10:29:13.749866 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:29:13.750181 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:29:13.750493 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:29:13.750802 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:29:13.751123 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:29:13.751425 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:29:13.751736 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:29:13.752078 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:29:13.752394 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:29:13.752649 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:29:13.752954 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:29:13.753039 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 06 10:29:13.753454 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-844822-1-iscsi {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:29:13.753544 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 06 10:29:13.753623 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:29:13.753839 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 06 10:29:13.753926 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:29:13.754171 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:29:13.754282 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 06 10:29:13.754484 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:29:13.754577 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 06 10:29:13.754782 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:29:13.754877 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:29:13.755096 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:29:13.755264 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:29:13.755402 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:29:13.755495 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:29:13.755788 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:29:13.755943 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:29:13.756139 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:29:13.757095 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:29:13.757260 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:29:13.757351 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:29:13.757482 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:29:13.757623 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:29:13.757707 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:29:13.757842 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:29:13.757936 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:29:13.758022 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:29:13.758108 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:29:13.758202 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:29:13.758282 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:29:13.758414 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:29:13.758497 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-844822-1-iscsi {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:29:13.758575 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:29:13.758700 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:29:13.758795 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:29:13.758884 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:29:13.758990 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:29:13.759089 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:29:13.759379 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-844822-1-iscsi {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:29:13.759473 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:29:13.759679 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:29:13.759763 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:29:13.760004 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:29:13.760103 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:29:13.760310 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:29:13.760397 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:29:13.760713 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:29:13.760801 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:29:13.761016 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:29:13.761116 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:29:13.761317 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:29:13.761417 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:29:13.761629 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:29:13.761723 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:29:13.761944 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:29:13.762042 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:29:13.762244 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:29:13.762328 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:29:13.762561 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:29:13.762646 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:29:13.762872 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:29:13.762971 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:29:13.763171 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:29:13.763266 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:29:13.763479 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:29:13.763573 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:29:13.763775 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:29:13.763883 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:29:13.764096 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:29:13.764195 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-844822-1-iscsi {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:29:13.764396 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:29:13.764482 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:29:13.764704 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:29:13.764798 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:29:13.765003 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:29:13.765098 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:29:13.765306 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:29:13.765460 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:29:13.765555 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:29:13.765768 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:29:13.765869 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:29:13.766076 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:29:13.766181 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:29:13.766389 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:29:13.766484 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:29:13.766707 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:29:13.766800 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:29:13.766966 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:29:13.767064 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:29:13.767211 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:29:13.767305 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:29:13.767774 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:29:13.767907 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:29:13.768107 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:29:13.768204 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:29:13.768408 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:29:13.768505 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:29:13.768708 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:29:13.768794 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:29:13.769511 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:29:13.769663 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:29:13.769813 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:29:13.770004 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:29:13.770199 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:29:13.770322 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:29:13.770503 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:29:13.770627 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:29:13.770804 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:29:13.770930 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:29:13.771104 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:29:13.771198 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:29:13.771415 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:29:13.771501 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:29:13.771724 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:29:13.771833 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:29:13.772065 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:29:13.772163 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:29:13.772366 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:29:13.772455 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:29:13.772644 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:29:13.772733 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:29:13.772893 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:29:13.773051 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.42 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:29:13.773211 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:29:13.773310 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.42 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:29:13.773529 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:29:13.773616 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:29:13.773832 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:29:13.773936 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:29:13.774134 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:29:13.774235 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:29:13.774436 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:29:13.774523 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:29:13.774738 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:29:13.774823 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:29:13.775040 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:29:13.775142 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:29:13.775341 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:29:13.775427 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:29:13.775638 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:29:13.775731 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:29:13.775963 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:29:13.776084 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:29:13.776273 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:29:13.776368 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:29:13.776581 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:29:13.776667 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:29:13.776877 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:29:13.776971 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:29:13.777107 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:29:13.777191 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:29:13.777404 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:29:13.777490 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:29:13.777700 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:29:13.777865 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.42 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:29:13.778009 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:29:13.778102 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.42 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:29:13.778308 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:29:13.778393 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:29:13.778606 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:29:13.778704 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:29:13.778904 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:29:13.779019 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:29:13.779197 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:29:13.779326 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:29:13.779494 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:29:13.779642 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:29:13.779867 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:29:13.779981 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:29:13.780177 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:29:13.780285 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:29:13.780476 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:29:13.780587 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:29:13.780774 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:29:13.780888 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:29:13.781072 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:29:13.781243 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:29:13.781370 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:29:13.781509 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:29:13.781669 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:29:13.781810 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:29:13.781967 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:29:13.782067 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:29:13.782275 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:29:13.782413 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:29:13.782587 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:29:13.782689 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:29:13.782886 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:29:13.782987 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:29:13.783183 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:29:13.783270 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:29:13.783480 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:29:13.783580 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:29:13.783775 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:29:13.783898 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:29:13.784113 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:29:13.784206 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:29:13.784410 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:29:13.784504 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:29:13.785291 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:29:13.785406 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:29:13.785642 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:29:13.785811 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:29:13.785949 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:29:13.786120 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:29:13.786254 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:29:13.786425 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:29:13.786557 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:29:13.786738 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:29:13.786862 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:29:13.787038 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:29:13.787164 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:29:13.787339 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:29:13.787467 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:29:13.787650 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:29:13.787811 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:29:13.787972 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:29:13.788120 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:29:13.788273 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:29:13.788422 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:29:13.788583 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:29:13.788724 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:29:13.788882 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:29:13.789027 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:29:13.789181 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:29:13.789329 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:29:13.789478 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:29:13.789644 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:29:13.789777 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:29:13.789948 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:29:13.790073 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:29:13.790251 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:29:13.790372 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:29:13.790569 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:29:13.790666 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:29:13.790872 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:29:13.790959 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:29:13.791173 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:29:13.791259 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:29:13.791488 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:29:13.791575 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:29:13.791808 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:29:13.791898 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:29:13.792113 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:29:13.792200 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:29:13.792459 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:29:13.792568 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:29:13.792710 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:29:13.792796 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:29:13.793011 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:29:13.793097 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:29:13.793330 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:29:13.793425 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.793634 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:29:13.793729 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.793937 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:29:13.794024 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.794236 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:29:13.794337 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.794537 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:29:13.794624 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.794837 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:29:13.794932 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.795137 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:29:13.795232 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.795435 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:29:13.795527 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.795737 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:29:13.795859 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.796068 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:29:13.796158 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.796380 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:29:13.796475 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.796685 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.796770 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:29:13.796987 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:29:13.797074 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.797289 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:29:13.797375 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.797591 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:29:13.797677 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.797906 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:29:13.798040 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.798212 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.798305 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.798524 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.798609 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.798835 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.798931 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.799145 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.799266 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.799453 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.799572 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.799770 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.799888 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.800105 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.800273 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.800441 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.800599 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.800833 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.801000 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.801215 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.801330 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.801524 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.801646 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.801841 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.801961 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.802155 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.802277 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.802462 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.802660 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.802758 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.802902 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.803056 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.803234 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.803370 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.803552 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.803696 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.803893 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.804018 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.804212 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.804322 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.804523 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.804612 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.804838 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.804925 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.805165 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.805260 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.805485 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.805571 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.805795 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.805883 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.806123 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.806219 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.806433 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.806561 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.806743 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.806829 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.807049 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.807144 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.807360 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.807446 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.807665 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.807751 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.807994 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.808097 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.808299 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.808386 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.808598 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.808685 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.808898 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.808992 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.809196 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.809291 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.809499 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.809585 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.809798 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.809886 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.810112 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.810198 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.810426 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.810511 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.810722 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.810809 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.811029 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.811114 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.811334 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.811418 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.811638 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.811725 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.811982 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.812069 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.812289 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.812387 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.812590 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.812726 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.812894 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.812988 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.813197 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.813293 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.813498 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.813585 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.813797 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.813882 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.814100 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.814198 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.814396 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.814481 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.814700 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.814793 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.814994 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.815089 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.815290 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.815384 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.815596 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.815683 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.815961 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.816066 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.816268 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.816572 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.816658 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.816876 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.816972 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.817192 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.817294 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.817499 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.817624 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.817805 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.817901 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.818111 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.818204 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.818422 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.818508 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.818725 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.818819 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.819029 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.819114 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.819344 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.819430 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.819652 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.819746 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.819984 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.820073 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.820286 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.820373 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.820583 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.820684 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.820881 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.820983 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.821177 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.821263 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.821478 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.821569 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.821774 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.821860 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.822071 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.822158 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.822367 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.822454 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.822662 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.822836 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.822973 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.823120 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.823257 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.823392 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.823526 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.823661 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.823845 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.823991 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.824130 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.824266 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.824416 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.824551 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.824723 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.824870 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.825006 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.825142 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.825340 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.825478 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.825663 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.825803 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.825975 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.826114 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.826288 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.826435 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.826579 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.826667 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.826876 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.827009 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.827176 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.827307 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.827475 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.827618 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.827774 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.827936 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.828078 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.828213 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.828402 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.828538 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.828672 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.828761 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.828976 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.829115 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.829275 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.829407 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.829574 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.829705 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.829875 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.830007 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.830182 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.830322 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.830480 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.830613 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.830786 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.830996 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.831143 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.831275 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.831418 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.832063 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.832248 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.832426 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.832566 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.832732 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.832863 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.833044 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.833178 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.833354 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.833499 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.833665 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.833799 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.833980 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.834112 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.834286 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.834425 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.834596 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.834742 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.834886 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.835031 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.835175 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.835316 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.835478 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.835620 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.835804 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.835951 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.836117 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.836254 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.836429 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.836574 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.836719 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.836872 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.837005 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.837141 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.837325 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.837468 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.837649 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.837797 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.837953 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.838041 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.838256 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.838342 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.838561 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.838647 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.838862 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.838947 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.839164 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.839252 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.839468 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.839567 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.839764 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.839886 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.840084 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.840170 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.840388 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.840476 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.840692 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.840779 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.840994 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.841080 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.841299 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.841386 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.841597 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.841690 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.841905 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.841991 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.842208 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.842296 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.842506 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.842590 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.842800 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.842895 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.843102 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.843199 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.843413 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.843513 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.843714 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.843836 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.844051 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.844139 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.844363 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.844448 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.844659 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.844754 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.844955 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.845041 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.845263 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.845359 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.845562 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.845657 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.845857 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.845943 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.846153 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.846246 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.846453 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.846547 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.846758 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.846843 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.847117 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.847274 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.847438 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.847527 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.847752 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.847922 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.848084 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.848234 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.848388 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.848540 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.848692 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.848850 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.849001 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.849155 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.849321 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.849459 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.849629 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.849776 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.849946 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.850085 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.850263 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.850389 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.850566 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.850692 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.850867 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.850995 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.851187 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.851281 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.851495 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.851581 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.851814 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.851923 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.852121 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.852209 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.852424 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.852512 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.852763 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.852858 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.853056 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.853142 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.853357 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.853443 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.853665 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.853761 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.853987 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.854226 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.854319 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.854558 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.854653 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.854871 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.854965 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.855179 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.855273 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.855491 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.855586 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.855819 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.855908 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.856131 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.856216 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.856438 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.856537 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.856745 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.856838 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.857051 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.857147 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.857356 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.857451 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.857656 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.857745 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.857956 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.858042 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.858260 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.858345 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.858557 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.858650 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.858855 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.858941 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.859150 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.859246 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.859453 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.859539 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.859751 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.860048 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.860137 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.860356 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.860443 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.860652 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.860738 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.860959 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.861048 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.861256 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.861344 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.861559 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.861646 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.861856 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.861945 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.862170 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.862257 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.862472 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.862557 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.863311 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.863421 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.863668 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.863811 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.863984 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.864072 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.864320 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.864407 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.864619 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.864708 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.864943 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.865029 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.865249 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.865343 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.865553 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.865641 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.865862 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.865948 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.866159 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.866244 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.866460 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.866547 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.866760 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.866847 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.867062 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.867198 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.867359 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.867446 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.867662 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.867748 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.867988 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.868134 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.868286 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.868373 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.868589 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.868689 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.868889 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.868985 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.869191 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.869278 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.869490 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.869595 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.869786 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.869885 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.870087 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.870174 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.870382 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.870469 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.870689 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.870784 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.870991 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.871087 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.871286 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.871379 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.871595 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.871697 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.871904 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.872007 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.872204 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.872292 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.872497 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.872585 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.872797 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.872883 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.873090 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.873176 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.873397 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.873507 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.873692 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.873788 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.873988 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.874075 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.874282 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.874380 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.874581 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.874668 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.874880 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.874985 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.875174 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.875261 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.875471 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.875557 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.875771 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.875939 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.876093 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.876181 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.876406 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.876502 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.876714 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.876811 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.877016 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.877111 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.877309 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.877454 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.877594 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.877740 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.877902 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.878032 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.878203 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.878398 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.878580 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.878784 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.878948 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.879087 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.879229 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.879363 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.879508 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.879641 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.879862 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.880000 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.880136 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.880270 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.880416 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.880568 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.880702 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.880835 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.880969 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.881102 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.881243 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.881379 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.881513 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.881645 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.881781 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.881921 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.882055 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.882187 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.882331 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.882465 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.882599 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.882740 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.882877 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.883010 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.883143 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.883278 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.883426 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.883697 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.883867 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.884001 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.884149 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.884286 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.884422 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.884565 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.884701 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.884836 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.884980 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.885115 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.885262 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.885398 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.885533 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.885667 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.885801 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.885952 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.886096 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.886232 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.886374 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.886509 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.886650 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.886785 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.886927 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.887064 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.887199 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.887332 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.887512 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.887644 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.887853 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.887987 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.888124 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.888259 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.888422 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.888564 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.888737 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.888873 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.889053 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.889190 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.889352 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.889497 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.889654 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.889801 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.889941 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.890075 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.890243 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.890388 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.890545 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.890681 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.890847 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.890983 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.891148 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.891297 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.891430 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.891563 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.891738 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.891890 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.892063 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.892212 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.892348 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.892740 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.892917 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.893049 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.893217 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.893353 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.893515 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.893670 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.893813 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.893908 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.894647 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.894735 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.894974 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.895063 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.895296 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.895390 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.895619 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.895715 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.895940 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.896029 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.896245 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.896343 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.896547 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.896635 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.896851 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.896962 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.897160 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.897261 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.897472 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.897559 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.897781 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.897867 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.898089 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.898185 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.898398 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.898486 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.898707 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.898793 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.899012 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.899108 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.899309 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.899400 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.899616 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.899706 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.899946 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.900048 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.900252 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.900340 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.900572 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.900667 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.900882 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.900971 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.901181 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.901267 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.901484 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.901570 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.901783 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.901877 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.902085 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.902172 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.902383 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.902476 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.902682 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.902799 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.902996 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.903106 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.903292 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.903414 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.903605 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.903740 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.904036 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.904126 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.904341 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.904438 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.904640 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.904726 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.904955 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.905041 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.905258 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.905358 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.905619 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.905713 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.905936 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.906030 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.906252 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.906349 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.906560 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.906647 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.906857 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.906943 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.907156 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.907251 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.907463 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.907593 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.907794 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.907884 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.908105 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.908192 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.908408 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.908538 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.908713 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.908799 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.909011 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.909098 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.909319 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.909405 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.910223 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.910376 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.910530 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.910712 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.910846 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.911027 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.911251 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.911338 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.911567 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.911732 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.911924 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.912070 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.912203 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.912382 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.912522 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.912706 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.912807 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.913029 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.913116 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.913351 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.913438 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.913657 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.913746 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.913961 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.914056 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.914266 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.914353 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.914562 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.914650 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.914866 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.914952 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.915167 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.915254 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.915470 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.915559 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.915766 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.915893 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.916086 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.916175 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.916398 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.916487 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.916695 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.916781 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.917011 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.917108 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.917317 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.917413 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.917649 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.917738 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.917949 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.918049 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.918248 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.918337 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.918560 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.918647 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.918861 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.918958 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.919157 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.919244 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.919453 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.919548 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.919749 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.919873 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.920106 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.920202 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.920406 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.920494 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.920713 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.920807 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.921035 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.921132 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.921328 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.921424 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.921632 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.921720 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.921931 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.922025 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.922234 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.922321 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.922551 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.922641 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.922854 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.922942 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.923169 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.923266 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.923470 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.923560 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.923768 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.923948 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.924091 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.924189 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.924377 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.924465 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.924676 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.924771 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.924974 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.925073 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.925313 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.925411 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.925619 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.925707 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.925923 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.926030 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.926264 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.926353 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.926571 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.926659 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.926871 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.926967 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.927190 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.927277 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.927500 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.927595 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.927817 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.927910 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.928123 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.928211 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.928428 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.928552 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.928765 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.928864 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.929065 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.929152 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.929386 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.929480 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.929691 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.929816 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.929995 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.930083 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.930302 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.930467 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.930604 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.930692 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.930903 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.930988 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.931205 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.931300 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.931511 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.931597 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.931828 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.931918 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.932134 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.932233 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.932438 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.932525 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.932743 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.932837 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.933044 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.933139 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.933345 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.933431 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.933653 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.933747 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.933952 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.934046 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.934255 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.934353 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.934554 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.934765 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.934892 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.935087 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.935181 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.935398 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.935515 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.935707 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.935851 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.936038 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.936157 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.936347 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.936480 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.936654 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.936788 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.936959 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.937106 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.937265 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.937419 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.937578 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.937729 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.937866 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.938039 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.938185 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.938350 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.938502 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.938661 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.938822 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.938973 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.939150 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.939285 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.939460 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.939591 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.939768 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.939926 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.940097 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.940237 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.940406 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.940552 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.940753 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.941182 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.941270 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.941493 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.941754 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.941841 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.942079 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.942174 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.942393 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.942488 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.942700 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.942789 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.943005 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.943092 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.943312 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.943401 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.943620 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.943708 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.943951 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.944042 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.944260 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.944401 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.944567 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.944717 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.944855 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.944988 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.945176 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.945321 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.945504 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.945645 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.945819 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.945965 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.946126 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.946270 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.946432 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.946580 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.946739 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.946890 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.947050 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.947254 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.947398 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.947572 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.947718 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.947927 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.948061 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.948251 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.948383 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.948572 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.948716 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.948885 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.949022 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.949198 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.949294 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.949504 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.949599 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.949810 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.949898 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.950112 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.950208 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.950419 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.950513 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.950722 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.950807 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.951020 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.951107 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.951330 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.951417 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.951634 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.951739 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.951959 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.952060 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.952275 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.952364 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.952579 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.952667 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.952905 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.953100 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.953221 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.953436 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.953745 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.953839 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.954061 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.954155 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.954380 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.954468 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.954688 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.954776 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.954989 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.955088 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.955302 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.955391 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.955602 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.955688 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.955933 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.956038 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.956245 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.956333 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.957104 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.957222 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.957576 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.957677 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.957892 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.958086 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.958202 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.958364 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.958529 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.958673 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.958842 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.958976 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.959150 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.959286 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.959469 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.959588 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.959795 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.959932 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.960233 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.960319 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.960534 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.960663 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.960834 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.960983 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.961141 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.961308 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.961441 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.961633 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.961741 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.961949 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.962035 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.962254 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.962351 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.962577 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.962671 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.962885 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.962972 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.963191 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.963279 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.963488 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.963575 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.963801 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.963892 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.964115 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.964204 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.964417 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.964506 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.964727 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.964815 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.965038 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.965126 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.965342 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.965430 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.965637 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.965736 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.965946 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.966040 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.966252 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.966339 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.966556 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.966650 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.966860 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.966945 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.967161 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.967247 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.967473 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.967636 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.967777 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.967899 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.968100 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.968333 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.968423 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.968659 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.968754 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.968975 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.969068 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.969279 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.969378 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.969588 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.969675 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.969892 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.970042 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.970180 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.970327 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.970462 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.970603 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.970777 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.970916 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.971082 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.971241 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.971376 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.971510 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.971678 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.971862 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.971997 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.972751 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.972900 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.973039 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.973217 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.973368 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.973514 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.973649 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.973796 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.973933 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.974070 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.974203 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.974386 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.974532 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.974691 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.974824 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.974995 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.975228 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.975379 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.975560 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.975709 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.975918 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.976053 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.976232 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.976370 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.976543 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.976680 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.976853 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.976999 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.977142 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.977285 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.977444 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.977581 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.977733 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.977873 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.978041 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.978179 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.978329 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.978462 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.978637 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.978777 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.978926 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.979060 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.979235 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.979370 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.979536 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.979677 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.979863 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.979998 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.980174 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.980308 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.980482 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.980623 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.980790 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.980925 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.981098 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.981231 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.981405 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.981556 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.981694 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.981840 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.982010 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.982144 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.982348 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.982481 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.982656 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.982789 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.982968 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.983106 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.983284 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.983437 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.983600 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.983734 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.983923 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.984059 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.984228 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.984365 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.984534 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.984668 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.984831 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.984945 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.985132 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.985221 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.985443 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.985539 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.985748 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.985845 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.986046 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.986132 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.986343 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.986452 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.986647 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.986764 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.986945 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.987083 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.987243 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.987402 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.987539 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.987759 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.987957 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.988087 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.988197 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.988409 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.988523 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.988717 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.988807 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.989036 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.989123 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.989352 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.989512 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.989653 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.989799 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.989941 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.990077 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.990216 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.990362 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.990498 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.990631 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.990773 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.990916 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.991068 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.991203 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.991339 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.991473 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.991615 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.991770 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.991973 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.992111 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.992273 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.992411 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.992582 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.992719 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.992899 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.993054 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.993189 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.993322 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.993503 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.993641 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.993807 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.993945 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.994120 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.994257 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.994418 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.994564 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.994716 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.994847 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.994994 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.995129 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.995294 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.995445 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.995580 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.995714 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.995912 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.996047 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.996213 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.996424 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.996561 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.996701 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.996836 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.996981 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.997118 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.997260 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.997404 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.997539 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.997673 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.997813 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.997965 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.998099 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.998275 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.998424 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.998564 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.998649 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.998855 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.998945 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.999163 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.999278 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.999465 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.999553 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.999772 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:13.999879 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:14.000096 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:14.000196 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:14.000401 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:14.000498 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:14.000707 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:14.000795 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:14.001007 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:14.001095 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:14.001308 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:14.001410 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:14.001612 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:14.001699 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:14.001916 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:14.002002 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:14.002233 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:14.002329 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:14.002538 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:14.002626 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:14.002837 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:14.002923 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:14.003139 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:14.003242 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:14.003530 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:14.003704 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:14.003834 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:14.004129 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:14.004230 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:14.004453 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:14.004741 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:14.004829 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:14.005066 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:14.005337 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:14.005434 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:14.005689 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:14.005933 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:14.006030 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:14.006299 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:14.006501 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:14.006625 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:14.006933 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:14.007052 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:14.007240 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:14.007551 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:14.007648 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:14.007877 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:14.008076 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 06 10:29:14.008188 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:14.008503 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:14.008817 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:14.009139 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:14.009464 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:14.009773 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:14.010096 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:14.010422 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:14.010768 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:14.011079 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:14.011426 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:14.011754 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:14.012089 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:14.012398 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:14.012701 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:29:14.012943 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 06 10:29:14.067980 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: INFO dbcounter [None req-517ec411-a390-4fbf-a5c8-6ff55b792570 None None] Registered counter for database nova_api Jun 06 10:29:14.072194 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: INFO dbcounter [None req-2d9ceaa5-484e-4258-82e9-20a736b93e3a None None] Registered counter for database nova_api Jun 06 10:29:14.090160 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG oslo_db.sqlalchemy.engines [None req-517ec411-a390-4fbf-a5c8-6ff55b792570 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103361) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 06 10:29:14.092430 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG oslo_db.sqlalchemy.engines [None req-2d9ceaa5-484e-4258-82e9-20a736b93e3a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103360) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 06 10:29:14.097010 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG dbcounter [-] [103361] Writer thread running {{(pid=103361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 06 10:29:14.099391 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG dbcounter [-] [103360] Writer thread running {{(pid=103360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 06 10:29:14.155857 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.context [None req-517ec411-a390-4fbf-a5c8-6ff55b792570 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),b2cac780-caea-4a39-b7a4-6bc4960cc6e0(cell1) {{(pid=103361) load_cells /opt/stack/nova/nova/context.py:464}} Jun 06 10:29:14.156666 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.context [None req-2d9ceaa5-484e-4258-82e9-20a736b93e3a None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),b2cac780-caea-4a39-b7a4-6bc4960cc6e0(cell1) {{(pid=103360) load_cells /opt/stack/nova/nova/context.py:464}} Jun 06 10:29:14.160378 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG oslo_concurrency.lockutils [None req-517ec411-a390-4fbf-a5c8-6ff55b792570 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:29:14.161075 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG oslo_concurrency.lockutils [None req-2d9ceaa5-484e-4258-82e9-20a736b93e3a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:29:14.161951 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG oslo_concurrency.lockutils [None req-517ec411-a390-4fbf-a5c8-6ff55b792570 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:29:14.162615 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG oslo_concurrency.lockutils [None req-2d9ceaa5-484e-4258-82e9-20a736b93e3a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:29:14.162737 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG oslo_concurrency.lockutils [None req-517ec411-a390-4fbf-a5c8-6ff55b792570 None None] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:29:14.163399 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG oslo_concurrency.lockutils [None req-2d9ceaa5-484e-4258-82e9-20a736b93e3a None None] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:29:14.164707 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG oslo_concurrency.lockutils [None req-517ec411-a390-4fbf-a5c8-6ff55b792570 None None] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:29:14.165378 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG oslo_concurrency.lockutils [None req-2d9ceaa5-484e-4258-82e9-20a736b93e3a None None] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:29:14.166680 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: INFO dbcounter [None req-517ec411-a390-4fbf-a5c8-6ff55b792570 None None] Registered counter for database nova_cell0 Jun 06 10:29:14.167325 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: INFO dbcounter [None req-2d9ceaa5-484e-4258-82e9-20a736b93e3a None None] Registered counter for database nova_cell0 Jun 06 10:29:14.170684 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: INFO dbcounter [None req-517ec411-a390-4fbf-a5c8-6ff55b792570 None None] Registered counter for database nova_cell1 Jun 06 10:29:14.171253 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: INFO dbcounter [None req-2d9ceaa5-484e-4258-82e9-20a736b93e3a None None] Registered counter for database nova_cell1 Jun 06 10:29:14.178696 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG oslo_db.sqlalchemy.engines [None req-517ec411-a390-4fbf-a5c8-6ff55b792570 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103361) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 06 10:29:14.179954 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG oslo_db.sqlalchemy.engines [None req-517ec411-a390-4fbf-a5c8-6ff55b792570 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103361) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 06 10:29:14.182283 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG oslo_db.sqlalchemy.engines [None req-2d9ceaa5-484e-4258-82e9-20a736b93e3a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103360) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 06 10:29:14.185471 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG oslo_db.sqlalchemy.engines [None req-2d9ceaa5-484e-4258-82e9-20a736b93e3a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103360) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 06 10:29:14.186144 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG dbcounter [-] [103361] Writer thread running {{(pid=103361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 06 10:29:14.188319 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG dbcounter [-] [103360] Writer thread running {{(pid=103360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 06 10:29:14.188763 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG dbcounter [-] [103361] Writer thread running {{(pid=103361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 06 10:29:14.327127 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG dbcounter [-] [103360] Writer thread running {{(pid=103360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 06 10:29:14.334413 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: INFO dbcounter [None req-517ec411-a390-4fbf-a5c8-6ff55b792570 None None] Registered counter for database nova_cell0 Jun 06 10:29:14.336841 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: INFO dbcounter [None req-2d9ceaa5-484e-4258-82e9-20a736b93e3a None None] Registered counter for database nova_cell0 Jun 06 10:29:14.343210 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG oslo_db.sqlalchemy.engines [None req-517ec411-a390-4fbf-a5c8-6ff55b792570 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103361) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 06 10:29:14.346756 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG oslo_db.sqlalchemy.engines [None req-2d9ceaa5-484e-4258-82e9-20a736b93e3a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103360) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 06 10:29:14.348274 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG dbcounter [-] [103361] Writer thread running {{(pid=103361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 06 10:29:14.352157 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG dbcounter [-] [103360] Writer thread running {{(pid=103360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 06 10:29:14.808022 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: WARNING keystonemiddleware.auth_token [None req-2d9ceaa5-484e-4258-82e9-20a736b93e3a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 06 10:29:14.810853 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: WARNING keystonemiddleware.auth_token [None req-517ec411-a390-4fbf-a5c8-6ff55b792570 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 06 10:29:14.815206 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: WARNING keystonemiddleware.auth_token [None req-2d9ceaa5-484e-4258-82e9-20a736b93e3a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 06 10:29:14.818234 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: WARNING keystonemiddleware.auth_token [None req-517ec411-a390-4fbf-a5c8-6ff55b792570 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 06 10:29:15.033703 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: WARNING keystonemiddleware.auth_token [None req-2d9ceaa5-484e-4258-82e9-20a736b93e3a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 06 10:29:15.038679 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: WARNING keystonemiddleware.auth_token [None req-517ec411-a390-4fbf-a5c8-6ff55b792570 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 06 10:29:15.039946 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: WARNING keystonemiddleware.auth_token [None req-2d9ceaa5-484e-4258-82e9-20a736b93e3a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 06 10:29:15.044687 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: WARNING keystonemiddleware.auth_token [None req-517ec411-a390-4fbf-a5c8-6ff55b792570 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 06 10:29:15.044989 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55e312de79c0 pid: 103360 (default app) Jun 06 10:29:15.048060 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi [None req-2d9ceaa5-484e-4258-82e9-20a736b93e3a None None] Calling method '>' {{(pid=103360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:29:15.049239 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: INFO nova.api.openstack.requestlog [None req-2d9ceaa5-484e-4258-82e9-20a736b93e3a None None] 10.222.0.42 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.002744 Jun 06 10:29:15.049645 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: [pid: 103360|app: 0|req: 1/1] 10.222.0.42 () {50 vars in 788 bytes} [Mon Jun 6 10:29:15 2022] GET /compute/v2.1/ => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 10:29:15.049753 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55e312de79c0 pid: 103361 (default app) Jun 06 10:30:34.608946 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi [None req-2d9ceaa5-484e-4258-82e9-20a736b93e3a None None] Calling method '>' {{(pid=103360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:30:34.610683 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: INFO nova.api.openstack.requestlog [None req-2d9ceaa5-484e-4258-82e9-20a736b93e3a None None] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002157 Jun 06 10:30:34.611580 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: [pid: 103360|app: 0|req: 2/2] 10.222.0.42 () {54 vars in 930 bytes} [Mon Jun 6 10:30:34 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 10:30:34.630286 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG dbcounter [-] [103361] Writing DB stats nova_api:SELECT=3 {{(pid=103361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 10:30:34.631896 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG dbcounter [-] [103361] Writing DB stats nova_cell1:SELECT=3 {{(pid=103361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 10:30:34.633183 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG dbcounter [-] [103361] Writing DB stats nova_cell0:SELECT=3 {{(pid=103361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 10:30:34.634240 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG dbcounter [-] [103361] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 10:30:35.170307 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi [None req-db10d850-9891-41cf-8c6f-88dc2bd0405d admin admin] Calling method '>' {{(pid=103361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:30:35.206072 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: INFO nova.api.openstack.requestlog [None req-db10d850-9891-41cf-8c6f-88dc2bd0405d admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.585948 Jun 06 10:30:35.220131 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: [pid: 103361|app: 0|req: 1/3] 10.222.0.42 () {60 vars in 1291 bytes} [Mon Jun 6 10:30:34 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:30:37.577044 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi [None req-2d9ceaa5-484e-4258-82e9-20a736b93e3a None None] Calling method '>' {{(pid=103360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:30:37.578046 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: INFO nova.api.openstack.requestlog [None req-2d9ceaa5-484e-4258-82e9-20a736b93e3a None None] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001421 Jun 06 10:30:37.578437 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: [pid: 103360|app: 0|req: 3/4] 10.222.0.42 () {54 vars in 930 bytes} [Mon Jun 6 10:30:37 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 10:30:37.641430 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi [None req-a64bed12-7d7b-4bf3-bb27-2ffc1bc75dcb admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "name": "cirros256", "vcpus": 1, "swap": 0, "id": "c1", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 1, "ram": 256}} {{(pid=103361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 10:30:37.660818 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 06 10:30:37.660818 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: warnings.warn(msg) Jun 06 10:30:37.690662 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: INFO nova.api.openstack.requestlog [None req-a64bed12-7d7b-4bf3-bb27-2ffc1bc75dcb admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.105431 Jun 06 10:30:37.691399 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: [pid: 103361|app: 0|req: 2/5] 10.222.0.42 () {64 vars in 1282 bytes} [Mon Jun 6 10:30:37 2022] POST /compute/v2.1/flavors => generated 407 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 06 10:30:37.705147 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG dbcounter [-] [103360] Writing DB stats nova_api:SELECT=3 {{(pid=103360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 10:30:37.706444 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG dbcounter [-] [103360] Writing DB stats nova_cell0:SELECT=3 {{(pid=103360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 10:30:37.707160 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG dbcounter [-] [103360] Writing DB stats nova_cell1:SELECT=3 {{(pid=103360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 10:30:37.707928 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG dbcounter [-] [103360] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 10:30:37.938342 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi [None req-741bd1a7-b4d4-43f5-9a1b-d542ac250ca9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 10:30:37.941472 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 06 10:30:37.941472 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: warnings.warn(msg) Jun 06 10:30:38.021110 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: INFO nova.api.openstack.requestlog [None req-741bd1a7-b4d4-43f5-9a1b-d542ac250ca9 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.321684 Jun 06 10:30:38.033517 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: [pid: 103360|app: 0|req: 4/6] 10.222.0.42 () {64 vars in 1335 bytes} [Mon Jun 6 10:30:37 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:30:40.368734 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi [None req-a64bed12-7d7b-4bf3-bb27-2ffc1bc75dcb admin admin] Calling method '>' {{(pid=103361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:30:40.370392 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: INFO nova.api.openstack.requestlog [None req-a64bed12-7d7b-4bf3-bb27-2ffc1bc75dcb admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002194 Jun 06 10:30:40.370789 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: [pid: 103361|app: 0|req: 3/7] 10.222.0.42 () {54 vars in 930 bytes} [Mon Jun 6 10:30:40 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 10:30:40.483510 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi [None req-16df0bc3-2cd5-49a0-8980-539ae8ffc8e5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 5, "swap": 0, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 512, "name": "ds512M", "vcpus": 1, "os-flavor-access:is_public": true, "id": "d1"}} {{(pid=103360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 10:30:40.501956 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 06 10:30:40.501956 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: warnings.warn(msg) Jun 06 10:30:40.522817 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: INFO nova.api.openstack.requestlog [None req-16df0bc3-2cd5-49a0-8980-539ae8ffc8e5 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.146007 Jun 06 10:30:40.523395 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: [pid: 103360|app: 0|req: 5/8] 10.222.0.42 () {64 vars in 1282 bytes} [Mon Jun 6 10:30:40 2022] POST /compute/v2.1/flavors => generated 404 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 06 10:30:40.535683 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi [None req-1bf11a79-1222-4c6d-8ed9-b2ed20889d4f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 10:30:40.543028 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 06 10:30:40.543028 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: warnings.warn(msg) Jun 06 10:30:40.578733 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: INFO nova.api.openstack.requestlog [None req-1bf11a79-1222-4c6d-8ed9-b2ed20889d4f admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.047084 Jun 06 10:30:40.579831 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: [pid: 103361|app: 0|req: 4/9] 10.222.0.42 () {64 vars in 1335 bytes} [Mon Jun 6 10:30:40 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 10:30:42.917014 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi [None req-16df0bc3-2cd5-49a0-8980-539ae8ffc8e5 admin admin] Calling method '>' {{(pid=103360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:30:42.918044 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: INFO nova.api.openstack.requestlog [None req-16df0bc3-2cd5-49a0-8980-539ae8ffc8e5 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001480 Jun 06 10:30:42.918450 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: [pid: 103360|app: 0|req: 6/10] 10.222.0.42 () {54 vars in 930 bytes} [Mon Jun 6 10:30:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 10:30:42.983590 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi [None req-51b475d4-6bc8-4e86-9ca0-90ce29723871 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 10, "swap": 0, "name": "ds1G", "rxtx_factor": 1.0, "id": "d2", "vcpus": 1, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 1024}} {{(pid=103361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 10:30:43.004418 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: INFO nova.api.openstack.requestlog [None req-51b475d4-6bc8-4e86-9ca0-90ce29723871 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.079589 Jun 06 10:30:43.005410 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: [pid: 103361|app: 0|req: 5/11] 10.222.0.42 () {64 vars in 1282 bytes} [Mon Jun 6 10:30:42 2022] POST /compute/v2.1/flavors => generated 404 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 06 10:30:43.017545 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi [None req-68109704-1607-4d50-9d2a-c993ba966a75 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 10:30:43.041802 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: INFO nova.api.openstack.requestlog [None req-68109704-1607-4d50-9d2a-c993ba966a75 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028260 Jun 06 10:30:43.042557 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: [pid: 103360|app: 0|req: 7/12] 10.222.0.42 () {64 vars in 1335 bytes} [Mon Jun 6 10:30:43 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:30:45.386468 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi [None req-51b475d4-6bc8-4e86-9ca0-90ce29723871 admin admin] Calling method '>' {{(pid=103361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:30:45.387492 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: INFO nova.api.openstack.requestlog [None req-51b475d4-6bc8-4e86-9ca0-90ce29723871 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001458 Jun 06 10:30:45.387922 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: [pid: 103361|app: 0|req: 6/13] 10.222.0.42 () {54 vars in 930 bytes} [Mon Jun 6 10:30:45 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 10:30:45.447414 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi [None req-fbc0ecd5-d709-48c6-bff2-8d3f9135dcd4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "rxtx_factor": 1.0, "vcpus": 2, "ram": 2048, "name": "ds2G", "disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "id": "d3"}} {{(pid=103360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 10:30:45.464790 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: INFO nova.api.openstack.requestlog [None req-fbc0ecd5-d709-48c6-bff2-8d3f9135dcd4 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.070486 Jun 06 10:30:45.465341 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: [pid: 103360|app: 0|req: 8/14] 10.222.0.42 () {64 vars in 1282 bytes} [Mon Jun 6 10:30:45 2022] POST /compute/v2.1/flavors => generated 404 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 06 10:30:45.477685 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi [None req-3096631a-9393-4119-bbbc-6b1714f2cbd1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 10:30:45.500579 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: INFO nova.api.openstack.requestlog [None req-3096631a-9393-4119-bbbc-6b1714f2cbd1 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026481 Jun 06 10:30:45.501253 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: [pid: 103361|app: 0|req: 7/15] 10.222.0.42 () {64 vars in 1335 bytes} [Mon Jun 6 10:30:45 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:30:47.833236 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi [None req-fbc0ecd5-d709-48c6-bff2-8d3f9135dcd4 admin admin] Calling method '>' {{(pid=103360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:30:47.834837 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: INFO nova.api.openstack.requestlog [None req-fbc0ecd5-d709-48c6-bff2-8d3f9135dcd4 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002029 Jun 06 10:30:47.835237 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: [pid: 103360|app: 0|req: 9/16] 10.222.0.42 () {54 vars in 930 bytes} [Mon Jun 6 10:30:47 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 10:30:47.896693 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi [None req-e1cafc60-29c6-4de7-8e83-e07302438c41 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d4", "vcpus": 4, "rxtx_factor": 1.0, "ram": 4096, "name": "ds4G", "os-flavor-access:is_public": true, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 20}} {{(pid=103361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 10:30:47.917294 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: INFO nova.api.openstack.requestlog [None req-e1cafc60-29c6-4de7-8e83-e07302438c41 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.075782 Jun 06 10:30:47.918053 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: [pid: 103361|app: 0|req: 8/17] 10.222.0.42 () {64 vars in 1282 bytes} [Mon Jun 6 10:30:47 2022] POST /compute/v2.1/flavors => generated 404 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 06 10:30:47.930505 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi [None req-d982fced-be9b-44e6-b557-9bb0e8bbed6f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 10:30:47.953619 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: INFO nova.api.openstack.requestlog [None req-d982fced-be9b-44e6-b557-9bb0e8bbed6f admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026550 Jun 06 10:30:47.963866 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: [pid: 103360|app: 0|req: 10/18] 10.222.0.42 () {64 vars in 1335 bytes} [Mon Jun 6 10:30:47 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:30:50.351970 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi [None req-e1cafc60-29c6-4de7-8e83-e07302438c41 admin admin] Calling method '>' {{(pid=103361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:30:50.352987 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: INFO nova.api.openstack.requestlog [None req-e1cafc60-29c6-4de7-8e83-e07302438c41 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001484 Jun 06 10:30:50.353389 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: [pid: 103361|app: 0|req: 9/19] 10.222.0.42 () {54 vars in 930 bytes} [Mon Jun 6 10:30:50 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 10:30:50.424704 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi [None req-29adeaf8-8cda-4b8a-bd9a-1641a48eab37 admin admin] Calling method '>' {{(pid=103360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:30:50.452930 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: INFO nova.api.openstack.requestlog [None req-29adeaf8-8cda-4b8a-bd9a-1641a48eab37 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.092900 Jun 06 10:30:50.453752 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: [pid: 103360|app: 0|req: 11/20] 10.222.0.42 () {60 vars in 1291 bytes} [Mon Jun 6 10:30:50 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 10:30:52.817754 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi [None req-e1cafc60-29c6-4de7-8e83-e07302438c41 admin admin] Calling method '>' {{(pid=103361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:30:52.818772 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: INFO nova.api.openstack.requestlog [None req-e1cafc60-29c6-4de7-8e83-e07302438c41 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001497 Jun 06 10:30:52.819507 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: [pid: 103361|app: 0|req: 10/21] 10.222.0.42 () {54 vars in 930 bytes} [Mon Jun 6 10:30:52 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 10:30:52.891510 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi [None req-eb233b79-9284-4e32-8271-30484c16b550 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.tiny", "disk": 1, "vcpus": 1, "id": "1", "ram": 512, "swap": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 10:30:52.910018 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: INFO nova.api.openstack.requestlog [None req-eb233b79-9284-4e32-8271-30484c16b550 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.084393 Jun 06 10:30:52.910567 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: [pid: 103360|app: 0|req: 12/22] 10.222.0.42 () {64 vars in 1282 bytes} [Mon Jun 6 10:30:52 2022] POST /compute/v2.1/flavors => generated 402 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 06 10:30:52.922371 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi [None req-9523b363-2f0c-450e-b4e8-d16c8f5e6a64 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 10:30:52.948366 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: INFO nova.api.openstack.requestlog [None req-9523b363-2f0c-450e-b4e8-d16c8f5e6a64 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029382 Jun 06 10:30:52.949306 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: [pid: 103361|app: 0|req: 11/23] 10.222.0.42 () {64 vars in 1332 bytes} [Mon Jun 6 10:30:52 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 10:30:55.268871 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi [None req-eb233b79-9284-4e32-8271-30484c16b550 admin admin] Calling method '>' {{(pid=103360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:30:55.270672 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: INFO nova.api.openstack.requestlog [None req-eb233b79-9284-4e32-8271-30484c16b550 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002517 Jun 06 10:30:55.271158 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: [pid: 103360|app: 0|req: 13/24] 10.222.0.42 () {54 vars in 930 bytes} [Mon Jun 6 10:30:55 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 10:30:55.328820 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi [None req-4fb23c59-4ea8-478d-8833-1354771216e7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "vcpus": 1, "disk": 20, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.small", "id": "2", "ram": 2048}} {{(pid=103361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 10:30:55.346271 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: INFO nova.api.openstack.requestlog [None req-4fb23c59-4ea8-478d-8833-1354771216e7 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.069219 Jun 06 10:30:55.346818 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: [pid: 103361|app: 0|req: 12/25] 10.222.0.42 () {64 vars in 1282 bytes} [Mon Jun 6 10:30:55 2022] POST /compute/v2.1/flavors => generated 405 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 06 10:30:55.360353 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi [None req-449334a2-1139-4ffc-8178-ae8ed3b49e77 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 10:30:55.389004 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: INFO nova.api.openstack.requestlog [None req-449334a2-1139-4ffc-8178-ae8ed3b49e77 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033806 Jun 06 10:30:55.390152 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: [pid: 103360|app: 0|req: 14/26] 10.222.0.42 () {64 vars in 1332 bytes} [Mon Jun 6 10:30:55 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:30:57.745467 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi [None req-4fb23c59-4ea8-478d-8833-1354771216e7 admin admin] Calling method '>' {{(pid=103361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:30:57.746487 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: INFO nova.api.openstack.requestlog [None req-4fb23c59-4ea8-478d-8833-1354771216e7 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001477 Jun 06 10:30:57.746889 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: [pid: 103361|app: 0|req: 13/27] 10.222.0.42 () {54 vars in 930 bytes} [Mon Jun 6 10:30:57 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 10:30:57.807298 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi [None req-d0551bc4-1d03-4fbf-a72f-33134d287574 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.medium", "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "vcpus": 2, "ram": 4096, "disk": 40, "id": "3", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0}} {{(pid=103360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 10:30:57.826495 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: INFO nova.api.openstack.requestlog [None req-d0551bc4-1d03-4fbf-a72f-33134d287574 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.071854 Jun 06 10:30:57.827038 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: [pid: 103360|app: 0|req: 15/28] 10.222.0.42 () {64 vars in 1282 bytes} [Mon Jun 6 10:30:57 2022] POST /compute/v2.1/flavors => generated 406 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 06 10:30:57.839448 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi [None req-00c0ea9a-0814-4c24-9b0b-074467189ae4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 10:30:57.867005 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: INFO nova.api.openstack.requestlog [None req-00c0ea9a-0814-4c24-9b0b-074467189ae4 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031239 Jun 06 10:30:57.867677 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: [pid: 103361|app: 0|req: 14/29] 10.222.0.42 () {64 vars in 1332 bytes} [Mon Jun 6 10:30:57 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:31:00.244966 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi [None req-d0551bc4-1d03-4fbf-a72f-33134d287574 admin admin] Calling method '>' {{(pid=103360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:31:00.245983 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: INFO nova.api.openstack.requestlog [None req-d0551bc4-1d03-4fbf-a72f-33134d287574 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001485 Jun 06 10:31:00.246419 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: [pid: 103360|app: 0|req: 16/30] 10.222.0.42 () {54 vars in 930 bytes} [Mon Jun 6 10:31:00 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 10:31:00.305385 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi [None req-1e64ecb6-842f-4bf8-b981-4fb420425f4b admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "os-flavor-access:is_public": true, "disk": 80, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "4", "rxtx_factor": 1.0, "ram": 8192, "vcpus": 4, "name": "m1.large"}} {{(pid=103361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 10:31:00.323985 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: INFO nova.api.openstack.requestlog [None req-1e64ecb6-842f-4bf8-b981-4fb420425f4b admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.071030 Jun 06 10:31:00.324539 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: [pid: 103361|app: 0|req: 15/31] 10.222.0.42 () {64 vars in 1282 bytes} [Mon Jun 6 10:31:00 2022] POST /compute/v2.1/flavors => generated 405 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 06 10:31:00.336869 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi [None req-d1f6a13f-3063-4f7a-8b8b-2496c6754ccc admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 10:31:00.360589 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: INFO nova.api.openstack.requestlog [None req-d1f6a13f-3063-4f7a-8b8b-2496c6754ccc admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027424 Jun 06 10:31:00.361443 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: [pid: 103360|app: 0|req: 17/32] 10.222.0.42 () {64 vars in 1332 bytes} [Mon Jun 6 10:31:00 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 10:31:02.716226 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi [None req-1e64ecb6-842f-4bf8-b981-4fb420425f4b admin admin] Calling method '>' {{(pid=103361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:31:02.717261 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: INFO nova.api.openstack.requestlog [None req-1e64ecb6-842f-4bf8-b981-4fb420425f4b admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001499 Jun 06 10:31:02.717908 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: [pid: 103361|app: 0|req: 16/33] 10.222.0.42 () {54 vars in 930 bytes} [Mon Jun 6 10:31:02 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 10:31:02.780471 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi [None req-4fff6e84-3e7e-4601-9b86-6b4a6199a6de admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "swap": 0, "vcpus": 8, "name": "m1.xlarge", "os-flavor-access:is_public": true, "disk": 160, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 16384, "id": "5"}} {{(pid=103360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 10:31:02.805234 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: INFO nova.api.openstack.requestlog [None req-4fff6e84-3e7e-4601-9b86-6b4a6199a6de admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.080510 Jun 06 10:31:02.806063 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: [pid: 103360|app: 0|req: 18/34] 10.222.0.42 () {64 vars in 1282 bytes} [Mon Jun 6 10:31:02 2022] POST /compute/v2.1/flavors => generated 408 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 06 10:31:02.821112 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi [None req-82fd4443-4147-4eab-aa6f-353328f28d18 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 10:31:02.847566 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: INFO nova.api.openstack.requestlog [None req-82fd4443-4147-4eab-aa6f-353328f28d18 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033262 Jun 06 10:31:02.848740 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: [pid: 103361|app: 0|req: 17/35] 10.222.0.42 () {64 vars in 1332 bytes} [Mon Jun 6 10:31:02 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:31:27.756172 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi [None req-4fff6e84-3e7e-4601-9b86-6b4a6199a6de admin admin] Calling method '>' {{(pid=103360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:31:27.757191 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: INFO nova.api.openstack.requestlog [None req-4fff6e84-3e7e-4601-9b86-6b4a6199a6de admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001467 Jun 06 10:31:27.757587 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: [pid: 103360|app: 0|req: 19/36] 10.222.0.42 () {54 vars in 930 bytes} [Mon Jun 6 10:31:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 10:31:27.769701 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG dbcounter [-] [103361] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=10,nova_api:SAVEPOINT=5,nova_api:RELEASE=5 {{(pid=103361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 10:31:27.819486 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi [None req-b1f41a1f-2cbf-4706-84b2-9dc7ec866d35 admin admin] Calling method '>' {{(pid=103361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:31:27.837848 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: INFO nova.api.openstack.requestlog [None req-b1f41a1f-2cbf-4706-84b2-9dc7ec866d35 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.074302 Jun 06 10:31:27.838383 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: [pid: 103361|app: 0|req: 18/37] 10.222.0.42 () {60 vars in 1291 bytes} [Mon Jun 6 10:31:27 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 10:31:28.846064 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi [None req-4fff6e84-3e7e-4601-9b86-6b4a6199a6de admin admin] Calling method '>' {{(pid=103360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:31:28.847072 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: INFO nova.api.openstack.requestlog [None req-4fff6e84-3e7e-4601-9b86-6b4a6199a6de admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001445 Jun 06 10:31:28.847609 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: [pid: 103360|app: 0|req: 20/38] 10.222.0.42 () {56 vars in 1074 bytes} [Mon Jun 6 10:31:28 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 06 10:31:29.058775 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi [None req-1b9d76de-eff2-44b3-9738-62c61d177bfb admin admin] Calling method '>' {{(pid=103361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:31:29.065018 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: INFO nova.api.openstack.wsgi [None req-1b9d76de-eff2-44b3-9738-62c61d177bfb admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 06 10:31:29.068216 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi [None req-1b9d76de-eff2-44b3-9738-62c61d177bfb admin admin] Request method failure captured: Jun 06 10:31:29.068216 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 06 10:31:29.068216 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: Accept: application/json Jun 06 10:31:29.068216 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: Accept-Encoding: gzip, deflate Jun 06 10:31:29.068216 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: Connection: keep-alive Jun 06 10:31:29.068216 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: Content-Length: 0 Jun 06 10:31:29.068216 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: Host: 10.222.0.42 Jun 06 10:31:29.068216 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: Openstack-Api-Version: compute 2.90 Jun 06 10:31:29.068216 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: Openstack-System-Scope: None Jun 06 10:31:29.068216 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: User-Agent: python-novaclient Jun 06 10:31:29.068216 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: X-Auth-Token: gAAAAABindeAyZcg0LJs5wvY4cPfbs0JuhdRbTFDvsdyHv_x9m1aV_9i9_888gyLJjj03au3SwUSJkCBjziKS6jB-FHaUNYV6zN26Kh1lPoGp8GXKLeicXMiEcBj__WM4mn7f6Sbllzcho_Ft9vD3vTkWoj1A_p_KXvLip1gqC36_mvu8nWa2aM Jun 06 10:31:29.068216 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: X-Domain-Id: None Jun 06 10:31:29.068216 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: X-Domain-Name: None Jun 06 10:31:29.068216 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: X-Identity-Status: Confirmed Jun 06 10:31:29.068216 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: X-Is-Admin-Project: True Jun 06 10:31:29.068216 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: X-Openstack-Nova-Api-Version: 2.90 Jun 06 10:31:29.068216 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: X-Project-Domain-Id: default Jun 06 10:31:29.068216 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: X-Project-Domain-Name: Default Jun 06 10:31:29.068216 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: X-Project-Id: 863195bccbf14e04a9a61a90f52ba9f1 Jun 06 10:31:29.068216 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: X-Project-Name: admin Jun 06 10:31:29.068216 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: X-Role: reader,member,admin Jun 06 10:31:29.068216 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: X-Roles: reader,member,admin Jun 06 10:31:29.069912 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/863195bccbf14e04a9a61a90f52ba9f1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/863195bccbf14e04a9a61a90f52ba9f1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/863195bccbf14e04a9a61a90f52ba9f1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_863195bccbf14e04a9a61a90f52ba9f1", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Jun 06 10:31:29.069912 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: X-Tenant: admin Jun 06 10:31:29.069912 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: X-Tenant-Id: 863195bccbf14e04a9a61a90f52ba9f1 Jun 06 10:31:29.069912 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: X-Tenant-Name: admin Jun 06 10:31:29.069912 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: X-User: admin Jun 06 10:31:29.069912 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: X-User-Domain-Id: default Jun 06 10:31:29.069912 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: X-User-Domain-Name: Default Jun 06 10:31:29.069912 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: X-User-Id: dc953d765b8048419427028bb5821273 Jun 06 10:31:29.069912 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: X-User-Name: admin Jun 06 10:31:29.069912 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: method: > Jun 06 10:31:29.069912 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: exception: Flavor 42 could not be found. Jun 06 10:31:29.069912 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: action_args: {'id': '42'} Jun 06 10:31:29.069912 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: {{(pid=103361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 10:31:29.069912 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 10:31:29.070879 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 06 10:31:29.070879 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 06 10:31:29.070879 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 06 10:31:29.070879 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 06 10:31:29.070879 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 06 10:31:29.070879 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 06 10:31:29.070879 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 06 10:31:29.070879 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 06 10:31:29.070879 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 06 10:31:29.070879 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 10:31:29.070879 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 06 10:31:29.070879 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 06 10:31:29.070879 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 06 10:31:29.070879 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi Jun 06 10:31:29.070879 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 10:31:29.070879 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi Jun 06 10:31:29.070879 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 10:31:29.070879 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 10:31:29.070879 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 10:31:29.072104 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 10:31:29.072104 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 10:31:29.072104 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 10:31:29.072104 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 10:31:29.072104 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 06 10:31:29.072104 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 06 10:31:29.072104 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 06 10:31:29.072104 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi Jun 06 10:31:29.072104 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 10:31:29.072104 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi Jun 06 10:31:29.072104 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 10:31:29.072104 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 10:31:29.072104 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 10:31:29.072104 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 10:31:29.072104 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 10:31:29.072104 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 06 10:31:29.072104 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi Jun 06 10:31:29.072104 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi [None req-1b9d76de-eff2-44b3-9738-62c61d177bfb admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 10:31:29.073198 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: INFO nova.api.openstack.requestlog [None req-1b9d76de-eff2-44b3-9738-62c61d177bfb admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.061888 Jun 06 10:31:29.073198 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: [pid: 103361|app: 0|req: 19/39] 10.222.0.42 () {60 vars in 1190 bytes} [Mon Jun 6 10:31:29 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 06 10:31:29.079332 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi [None req-93e3030e-5f87-47c3-9387-4b0491653013 admin admin] Calling method '>' {{(pid=103360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:31:29.082475 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG dbcounter [-] [103360] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 10:31:29.103338 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: INFO nova.api.openstack.requestlog [None req-93e3030e-5f87-47c3-9387-4b0491653013 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027581 Jun 06 10:31:29.103898 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: [pid: 103360|app: 0|req: 21/40] 10.222.0.42 () {60 vars in 1210 bytes} [Mon Jun 6 10:31:29 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 10:31:29.114191 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi [None req-bf3f6c3d-bfdb-4ca6-a897-69b39527c858 admin admin] Calling method '>' {{(pid=103361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:31:29.134960 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: INFO nova.api.openstack.requestlog [None req-bf3f6c3d-bfdb-4ca6-a897-69b39527c858 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024955 Jun 06 10:31:29.135505 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: [pid: 103361|app: 0|req: 20/41] 10.222.0.42 () {60 vars in 1210 bytes} [Mon Jun 6 10:31:29 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 10:31:29.145892 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi [None req-96f073a6-41be-4753-b592-1952b1dcb7a5 admin admin] Calling method '>' {{(pid=103360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:31:29.152215 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: INFO nova.api.openstack.wsgi [None req-96f073a6-41be-4753-b592-1952b1dcb7a5 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 06 10:31:29.155408 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi [None req-96f073a6-41be-4753-b592-1952b1dcb7a5 admin admin] Request method failure captured: Jun 06 10:31:29.155408 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 06 10:31:29.155408 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: Accept: application/json Jun 06 10:31:29.155408 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: Accept-Encoding: gzip, deflate Jun 06 10:31:29.155408 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: Connection: keep-alive Jun 06 10:31:29.155408 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: Content-Length: 0 Jun 06 10:31:29.155408 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: Host: 10.222.0.42 Jun 06 10:31:29.155408 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: Openstack-Api-Version: compute 2.90 Jun 06 10:31:29.155408 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: Openstack-System-Scope: None Jun 06 10:31:29.155408 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: User-Agent: python-novaclient Jun 06 10:31:29.155408 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: X-Auth-Token: gAAAAABindeAyZcg0LJs5wvY4cPfbs0JuhdRbTFDvsdyHv_x9m1aV_9i9_888gyLJjj03au3SwUSJkCBjziKS6jB-FHaUNYV6zN26Kh1lPoGp8GXKLeicXMiEcBj__WM4mn7f6Sbllzcho_Ft9vD3vTkWoj1A_p_KXvLip1gqC36_mvu8nWa2aM Jun 06 10:31:29.155408 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: X-Domain-Id: None Jun 06 10:31:29.155408 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: X-Domain-Name: None Jun 06 10:31:29.155408 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: X-Identity-Status: Confirmed Jun 06 10:31:29.155408 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: X-Is-Admin-Project: True Jun 06 10:31:29.155408 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: X-Openstack-Nova-Api-Version: 2.90 Jun 06 10:31:29.155408 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: X-Project-Domain-Id: default Jun 06 10:31:29.155408 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: X-Project-Domain-Name: Default Jun 06 10:31:29.155408 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: X-Project-Id: 863195bccbf14e04a9a61a90f52ba9f1 Jun 06 10:31:29.155408 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: X-Project-Name: admin Jun 06 10:31:29.155408 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: X-Role: reader,member,admin Jun 06 10:31:29.155408 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: X-Roles: reader,member,admin Jun 06 10:31:29.156983 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/863195bccbf14e04a9a61a90f52ba9f1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/863195bccbf14e04a9a61a90f52ba9f1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/863195bccbf14e04a9a61a90f52ba9f1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_863195bccbf14e04a9a61a90f52ba9f1", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Jun 06 10:31:29.156983 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: X-Tenant: admin Jun 06 10:31:29.156983 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: X-Tenant-Id: 863195bccbf14e04a9a61a90f52ba9f1 Jun 06 10:31:29.156983 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: X-Tenant-Name: admin Jun 06 10:31:29.156983 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: X-User: admin Jun 06 10:31:29.156983 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: X-User-Domain-Id: default Jun 06 10:31:29.156983 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: X-User-Domain-Name: Default Jun 06 10:31:29.156983 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: X-User-Id: dc953d765b8048419427028bb5821273 Jun 06 10:31:29.156983 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: X-User-Name: admin Jun 06 10:31:29.156983 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: method: > Jun 06 10:31:29.156983 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: exception: Flavor 42 could not be found. Jun 06 10:31:29.156983 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: action_args: {'id': '42'} Jun 06 10:31:29.156983 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: {{(pid=103360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 10:31:29.156983 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 10:31:29.158830 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 06 10:31:29.158830 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 06 10:31:29.158830 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 06 10:31:29.158830 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 06 10:31:29.158830 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 06 10:31:29.158830 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 06 10:31:29.158830 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 06 10:31:29.158830 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 06 10:31:29.158830 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 06 10:31:29.158830 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 10:31:29.158830 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 06 10:31:29.158830 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 06 10:31:29.158830 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 06 10:31:29.158830 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi Jun 06 10:31:29.158830 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 10:31:29.158830 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi Jun 06 10:31:29.158830 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 10:31:29.158830 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 10:31:29.158830 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 10:31:29.160203 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 10:31:29.160203 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 10:31:29.160203 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 10:31:29.160203 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 10:31:29.160203 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 06 10:31:29.160203 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 06 10:31:29.160203 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 06 10:31:29.160203 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi Jun 06 10:31:29.160203 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 10:31:29.160203 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi Jun 06 10:31:29.160203 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 10:31:29.160203 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 10:31:29.160203 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 10:31:29.160203 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 10:31:29.160203 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 10:31:29.160203 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 06 10:31:29.160203 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi Jun 06 10:31:29.160203 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi [None req-96f073a6-41be-4753-b592-1952b1dcb7a5 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 10:31:29.161427 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: INFO nova.api.openstack.requestlog [None req-96f073a6-41be-4753-b592-1952b1dcb7a5 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.015615 Jun 06 10:31:29.161427 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: [pid: 103360|app: 0|req: 22/42] 10.222.0.42 () {60 vars in 1190 bytes} [Mon Jun 6 10:31:29 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 06 10:31:30.027466 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi [None req-bf3f6c3d-bfdb-4ca6-a897-69b39527c858 admin admin] Calling method '>' {{(pid=103361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:31:30.028568 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: INFO nova.api.openstack.requestlog [None req-bf3f6c3d-bfdb-4ca6-a897-69b39527c858 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001552 Jun 06 10:31:30.029038 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: [pid: 103361|app: 0|req: 21/43] 10.222.0.42 () {56 vars in 1074 bytes} [Mon Jun 6 10:31:30 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 10:31:30.217040 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi [None req-cec070dc-85df-4818-b747-a034e7017c3c admin admin] Calling method '>' {{(pid=103360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:31:30.223188 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: INFO nova.api.openstack.wsgi [None req-cec070dc-85df-4818-b747-a034e7017c3c admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 06 10:31:30.224733 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi [None req-cec070dc-85df-4818-b747-a034e7017c3c admin admin] Request method failure captured: Jun 06 10:31:30.224733 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 06 10:31:30.224733 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: Accept: application/json Jun 06 10:31:30.224733 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: Accept-Encoding: gzip, deflate Jun 06 10:31:30.224733 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: Connection: keep-alive Jun 06 10:31:30.224733 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: Content-Length: 0 Jun 06 10:31:30.224733 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: Host: 10.222.0.42 Jun 06 10:31:30.224733 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: Openstack-Api-Version: compute 2.90 Jun 06 10:31:30.224733 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: Openstack-System-Scope: None Jun 06 10:31:30.224733 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: User-Agent: python-novaclient Jun 06 10:31:30.224733 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: X-Auth-Token: gAAAAABindeCjNOE42bqXMwAO7xyL6GE9jd2oH7b3v-JHThAxzMdtr6LtpMsAQA5GrWNZUI0KWKZgRbhwVMcR1EPUp6Nkuh6vIManxblHmE6cUHj55qzwSFNgagIGvOIXLd2ZoxSNEaawxXwIS_FgMRZjFNCNSxIjCS5qH_6NTyXqVe-8ngE_CE Jun 06 10:31:30.224733 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: X-Domain-Id: None Jun 06 10:31:30.224733 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: X-Domain-Name: None Jun 06 10:31:30.224733 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: X-Identity-Status: Confirmed Jun 06 10:31:30.224733 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: X-Is-Admin-Project: True Jun 06 10:31:30.224733 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: X-Openstack-Nova-Api-Version: 2.90 Jun 06 10:31:30.224733 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: X-Project-Domain-Id: default Jun 06 10:31:30.224733 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: X-Project-Domain-Name: Default Jun 06 10:31:30.224733 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: X-Project-Id: 863195bccbf14e04a9a61a90f52ba9f1 Jun 06 10:31:30.224733 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: X-Project-Name: admin Jun 06 10:31:30.224733 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: X-Role: reader,member,admin Jun 06 10:31:30.224733 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: X-Roles: reader,member,admin Jun 06 10:31:30.226225 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/863195bccbf14e04a9a61a90f52ba9f1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/863195bccbf14e04a9a61a90f52ba9f1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/863195bccbf14e04a9a61a90f52ba9f1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_863195bccbf14e04a9a61a90f52ba9f1", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Jun 06 10:31:30.226225 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: X-Tenant: admin Jun 06 10:31:30.226225 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: X-Tenant-Id: 863195bccbf14e04a9a61a90f52ba9f1 Jun 06 10:31:30.226225 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: X-Tenant-Name: admin Jun 06 10:31:30.226225 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: X-User: admin Jun 06 10:31:30.226225 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: X-User-Domain-Id: default Jun 06 10:31:30.226225 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: X-User-Domain-Name: Default Jun 06 10:31:30.226225 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: X-User-Id: dc953d765b8048419427028bb5821273 Jun 06 10:31:30.226225 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: X-User-Name: admin Jun 06 10:31:30.226225 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: method: > Jun 06 10:31:30.226225 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: exception: Flavor 84 could not be found. Jun 06 10:31:30.226225 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: action_args: {'id': '84'} Jun 06 10:31:30.226225 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: {{(pid=103360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 10:31:30.226225 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 10:31:30.227021 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 06 10:31:30.227021 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 06 10:31:30.227021 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 06 10:31:30.227021 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 06 10:31:30.227021 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 06 10:31:30.227021 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 06 10:31:30.227021 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 06 10:31:30.227021 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 06 10:31:30.227021 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 06 10:31:30.227021 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 10:31:30.227021 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 06 10:31:30.227021 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 06 10:31:30.227021 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 06 10:31:30.227021 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi Jun 06 10:31:30.227021 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 10:31:30.227021 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi Jun 06 10:31:30.227021 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 10:31:30.227021 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 10:31:30.227021 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 10:31:30.228111 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 10:31:30.228111 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 10:31:30.228111 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 10:31:30.228111 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 10:31:30.228111 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 06 10:31:30.228111 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 06 10:31:30.228111 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 06 10:31:30.228111 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi Jun 06 10:31:30.228111 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 10:31:30.228111 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi Jun 06 10:31:30.228111 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 10:31:30.228111 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 10:31:30.228111 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 10:31:30.228111 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 10:31:30.228111 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 10:31:30.228111 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 06 10:31:30.228111 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi Jun 06 10:31:30.228111 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi [None req-cec070dc-85df-4818-b747-a034e7017c3c admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 10:31:30.229112 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: INFO nova.api.openstack.requestlog [None req-cec070dc-85df-4818-b747-a034e7017c3c admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.062019 Jun 06 10:31:30.229112 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: [pid: 103360|app: 0|req: 23/44] 10.222.0.42 () {60 vars in 1190 bytes} [Mon Jun 6 10:31:30 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 06 10:31:30.236548 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi [None req-c08f772e-7c38-4eda-a17e-ae212d5d8951 admin admin] Calling method '>' {{(pid=103361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:31:30.251436 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: INFO nova.api.openstack.requestlog [None req-c08f772e-7c38-4eda-a17e-ae212d5d8951 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019006 Jun 06 10:31:30.251961 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: [pid: 103361|app: 0|req: 22/45] 10.222.0.42 () {60 vars in 1210 bytes} [Mon Jun 6 10:31:30 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 06 10:31:30.261151 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi [None req-10322664-f13c-4074-a172-8afe69a7dd62 admin admin] Calling method '>' {{(pid=103360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:31:30.278956 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: INFO nova.api.openstack.requestlog [None req-10322664-f13c-4074-a172-8afe69a7dd62 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.021264 Jun 06 10:31:30.279492 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: [pid: 103360|app: 0|req: 24/46] 10.222.0.42 () {60 vars in 1210 bytes} [Mon Jun 6 10:31:30 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 10:31:30.289541 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi [None req-a77f07a1-ab0a-4d48-8c17-b81c8bdaaca2 admin admin] Calling method '>' {{(pid=103361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:31:30.295977 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: INFO nova.api.openstack.wsgi [None req-a77f07a1-ab0a-4d48-8c17-b81c8bdaaca2 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 06 10:31:30.298413 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi [None req-a77f07a1-ab0a-4d48-8c17-b81c8bdaaca2 admin admin] Request method failure captured: Jun 06 10:31:30.298413 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 06 10:31:30.298413 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: Accept: application/json Jun 06 10:31:30.298413 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: Accept-Encoding: gzip, deflate Jun 06 10:31:30.298413 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: Connection: keep-alive Jun 06 10:31:30.298413 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: Content-Length: 0 Jun 06 10:31:30.298413 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: Host: 10.222.0.42 Jun 06 10:31:30.298413 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: Openstack-Api-Version: compute 2.90 Jun 06 10:31:30.298413 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: Openstack-System-Scope: None Jun 06 10:31:30.298413 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: User-Agent: python-novaclient Jun 06 10:31:30.298413 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: X-Auth-Token: gAAAAABindeCjNOE42bqXMwAO7xyL6GE9jd2oH7b3v-JHThAxzMdtr6LtpMsAQA5GrWNZUI0KWKZgRbhwVMcR1EPUp6Nkuh6vIManxblHmE6cUHj55qzwSFNgagIGvOIXLd2ZoxSNEaawxXwIS_FgMRZjFNCNSxIjCS5qH_6NTyXqVe-8ngE_CE Jun 06 10:31:30.298413 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: X-Domain-Id: None Jun 06 10:31:30.298413 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: X-Domain-Name: None Jun 06 10:31:30.298413 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: X-Identity-Status: Confirmed Jun 06 10:31:30.298413 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: X-Is-Admin-Project: True Jun 06 10:31:30.298413 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: X-Openstack-Nova-Api-Version: 2.90 Jun 06 10:31:30.298413 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: X-Project-Domain-Id: default Jun 06 10:31:30.298413 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: X-Project-Domain-Name: Default Jun 06 10:31:30.298413 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: X-Project-Id: 863195bccbf14e04a9a61a90f52ba9f1 Jun 06 10:31:30.298413 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: X-Project-Name: admin Jun 06 10:31:30.298413 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: X-Role: reader,member,admin Jun 06 10:31:30.298413 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: X-Roles: reader,member,admin Jun 06 10:31:30.299720 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/863195bccbf14e04a9a61a90f52ba9f1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/863195bccbf14e04a9a61a90f52ba9f1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/863195bccbf14e04a9a61a90f52ba9f1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_863195bccbf14e04a9a61a90f52ba9f1", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Jun 06 10:31:30.299720 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: X-Tenant: admin Jun 06 10:31:30.299720 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: X-Tenant-Id: 863195bccbf14e04a9a61a90f52ba9f1 Jun 06 10:31:30.299720 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: X-Tenant-Name: admin Jun 06 10:31:30.299720 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: X-User: admin Jun 06 10:31:30.299720 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: X-User-Domain-Id: default Jun 06 10:31:30.299720 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: X-User-Domain-Name: Default Jun 06 10:31:30.299720 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: X-User-Id: dc953d765b8048419427028bb5821273 Jun 06 10:31:30.299720 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: X-User-Name: admin Jun 06 10:31:30.299720 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: method: > Jun 06 10:31:30.299720 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: exception: Flavor 84 could not be found. Jun 06 10:31:30.299720 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: action_args: {'id': '84'} Jun 06 10:31:30.299720 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: {{(pid=103361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 10:31:30.299720 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 10:31:30.300558 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 06 10:31:30.300558 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 06 10:31:30.300558 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 06 10:31:30.300558 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 06 10:31:30.300558 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 06 10:31:30.300558 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 06 10:31:30.300558 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 06 10:31:30.300558 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 06 10:31:30.300558 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 06 10:31:30.300558 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 10:31:30.300558 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 06 10:31:30.300558 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 06 10:31:30.300558 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 06 10:31:30.300558 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi Jun 06 10:31:30.300558 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 10:31:30.300558 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi Jun 06 10:31:30.300558 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 10:31:30.300558 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 10:31:30.300558 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 10:31:30.302340 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 10:31:30.302340 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 10:31:30.302340 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 10:31:30.302340 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 10:31:30.302340 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 06 10:31:30.302340 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 06 10:31:30.302340 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 06 10:31:30.302340 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi Jun 06 10:31:30.302340 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 10:31:30.302340 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi Jun 06 10:31:30.302340 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 10:31:30.302340 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 10:31:30.302340 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 10:31:30.302340 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 10:31:30.302340 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 10:31:30.302340 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 06 10:31:30.302340 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi Jun 06 10:31:30.302340 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi [None req-a77f07a1-ab0a-4d48-8c17-b81c8bdaaca2 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 10:31:30.303622 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: INFO nova.api.openstack.requestlog [None req-a77f07a1-ab0a-4d48-8c17-b81c8bdaaca2 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.014532 Jun 06 10:31:30.303622 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: [pid: 103361|app: 0|req: 23/47] 10.222.0.42 () {60 vars in 1190 bytes} [Mon Jun 6 10:31:30 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 06 10:31:31.165561 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi [None req-10322664-f13c-4074-a172-8afe69a7dd62 admin admin] Calling method '>' {{(pid=103360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:31:31.166576 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: INFO nova.api.openstack.requestlog [None req-10322664-f13c-4074-a172-8afe69a7dd62 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001431 Jun 06 10:31:31.166970 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: [pid: 103360|app: 0|req: 25/48] 10.222.0.42 () {56 vars in 1074 bytes} [Mon Jun 6 10:31:31 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 10:31:31.362244 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi [None req-24ce9f23-ad9f-4bc3-bc6f-c23a7ac4b4ac admin admin] Calling method '>' {{(pid=103361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:31:31.368185 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: INFO nova.api.openstack.wsgi [None req-24ce9f23-ad9f-4bc3-bc6f-c23a7ac4b4ac admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 06 10:31:31.369683 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi [None req-24ce9f23-ad9f-4bc3-bc6f-c23a7ac4b4ac admin admin] Request method failure captured: Jun 06 10:31:31.369683 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 06 10:31:31.369683 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: Accept: application/json Jun 06 10:31:31.369683 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: Accept-Encoding: gzip, deflate Jun 06 10:31:31.369683 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: Connection: keep-alive Jun 06 10:31:31.369683 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: Content-Length: 0 Jun 06 10:31:31.369683 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: Host: 10.222.0.42 Jun 06 10:31:31.369683 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: Openstack-Api-Version: compute 2.90 Jun 06 10:31:31.369683 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: Openstack-System-Scope: None Jun 06 10:31:31.369683 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: User-Agent: python-novaclient Jun 06 10:31:31.369683 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: X-Auth-Token: gAAAAABindeDjOJ_4kTxCO3E-M7uFG3AOByC65bklKyKrk6COliDcq_eYkzPiLp04m7VFgHxX1YDS2bFVrYqHP1_CfG38xC7AABaXxpj0ybntqjaCcTimDbZdFLxcp6EPgOL-rnbWvs1MW8vIbRDEPf9weGE1eqjnTRY4hkJCOXVrjjO--nADNU Jun 06 10:31:31.369683 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: X-Domain-Id: None Jun 06 10:31:31.369683 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: X-Domain-Name: None Jun 06 10:31:31.369683 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: X-Identity-Status: Confirmed Jun 06 10:31:31.369683 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: X-Is-Admin-Project: True Jun 06 10:31:31.369683 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: X-Openstack-Nova-Api-Version: 2.90 Jun 06 10:31:31.369683 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: X-Project-Domain-Id: default Jun 06 10:31:31.369683 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: X-Project-Domain-Name: Default Jun 06 10:31:31.369683 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: X-Project-Id: 863195bccbf14e04a9a61a90f52ba9f1 Jun 06 10:31:31.369683 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: X-Project-Name: admin Jun 06 10:31:31.369683 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: X-Role: reader,member,admin Jun 06 10:31:31.369683 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: X-Roles: reader,member,admin Jun 06 10:31:31.371207 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/863195bccbf14e04a9a61a90f52ba9f1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/863195bccbf14e04a9a61a90f52ba9f1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/863195bccbf14e04a9a61a90f52ba9f1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_863195bccbf14e04a9a61a90f52ba9f1", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Jun 06 10:31:31.371207 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: X-Tenant: admin Jun 06 10:31:31.371207 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: X-Tenant-Id: 863195bccbf14e04a9a61a90f52ba9f1 Jun 06 10:31:31.371207 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: X-Tenant-Name: admin Jun 06 10:31:31.371207 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: X-User: admin Jun 06 10:31:31.371207 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: X-User-Domain-Id: default Jun 06 10:31:31.371207 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: X-User-Domain-Name: Default Jun 06 10:31:31.371207 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: X-User-Id: dc953d765b8048419427028bb5821273 Jun 06 10:31:31.371207 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: X-User-Name: admin Jun 06 10:31:31.371207 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: method: > Jun 06 10:31:31.371207 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: exception: Flavor 451 could not be found. Jun 06 10:31:31.371207 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: action_args: {'id': '451'} Jun 06 10:31:31.371207 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: {{(pid=103361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 10:31:31.371207 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 10:31:31.372120 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 06 10:31:31.372120 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 06 10:31:31.372120 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 06 10:31:31.372120 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 06 10:31:31.372120 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 06 10:31:31.372120 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 06 10:31:31.372120 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 06 10:31:31.372120 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 06 10:31:31.372120 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 06 10:31:31.372120 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 10:31:31.372120 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 06 10:31:31.372120 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 06 10:31:31.372120 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 06 10:31:31.372120 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi Jun 06 10:31:31.372120 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 10:31:31.372120 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi Jun 06 10:31:31.372120 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 10:31:31.372120 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 10:31:31.372120 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 10:31:31.373399 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 10:31:31.373399 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 10:31:31.373399 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 10:31:31.373399 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 10:31:31.373399 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 06 10:31:31.373399 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 06 10:31:31.373399 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 06 10:31:31.373399 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi Jun 06 10:31:31.373399 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 10:31:31.373399 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi Jun 06 10:31:31.373399 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 10:31:31.373399 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 10:31:31.373399 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 10:31:31.373399 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 10:31:31.373399 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 10:31:31.373399 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 06 10:31:31.373399 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi Jun 06 10:31:31.373399 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi [None req-24ce9f23-ad9f-4bc3-bc6f-c23a7ac4b4ac admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 10:31:31.374428 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: INFO nova.api.openstack.requestlog [None req-24ce9f23-ad9f-4bc3-bc6f-c23a7ac4b4ac admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.063435 Jun 06 10:31:31.374428 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: [pid: 103361|app: 0|req: 24/49] 10.222.0.42 () {60 vars in 1193 bytes} [Mon Jun 6 10:31:31 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 06 10:31:31.380967 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi [None req-126c2f97-2892-48cb-92ba-7a4175f42097 admin admin] Calling method '>' {{(pid=103360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:31:31.394816 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: INFO nova.api.openstack.requestlog [None req-126c2f97-2892-48cb-92ba-7a4175f42097 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017573 Jun 06 10:31:31.395612 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: [pid: 103360|app: 0|req: 26/50] 10.222.0.42 () {60 vars in 1210 bytes} [Mon Jun 6 10:31:31 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 10:31:31.404965 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi [None req-334896e9-612f-4f41-8c0f-9c37edbd6bfa admin admin] Calling method '>' {{(pid=103361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:31:31.419014 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: INFO nova.api.openstack.requestlog [None req-334896e9-612f-4f41-8c0f-9c37edbd6bfa admin admin] 10.222.0.42 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017535 Jun 06 10:31:31.419530 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: [pid: 103361|app: 0|req: 25/51] 10.222.0.42 () {60 vars in 1210 bytes} [Mon Jun 6 10:31:31 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 06 10:31:31.429331 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi [None req-f0c371a9-5235-485a-bc03-9c93ce88cd55 admin admin] Calling method '>' {{(pid=103360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:31:31.434532 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: INFO nova.api.openstack.wsgi [None req-f0c371a9-5235-485a-bc03-9c93ce88cd55 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 06 10:31:31.436080 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi [None req-f0c371a9-5235-485a-bc03-9c93ce88cd55 admin admin] Request method failure captured: Jun 06 10:31:31.436080 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 06 10:31:31.436080 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: Accept: application/json Jun 06 10:31:31.436080 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: Accept-Encoding: gzip, deflate Jun 06 10:31:31.436080 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: Connection: keep-alive Jun 06 10:31:31.436080 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: Content-Length: 0 Jun 06 10:31:31.436080 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: Host: 10.222.0.42 Jun 06 10:31:31.436080 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: Openstack-Api-Version: compute 2.90 Jun 06 10:31:31.436080 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: Openstack-System-Scope: None Jun 06 10:31:31.436080 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: User-Agent: python-novaclient Jun 06 10:31:31.436080 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: X-Auth-Token: gAAAAABindeDjOJ_4kTxCO3E-M7uFG3AOByC65bklKyKrk6COliDcq_eYkzPiLp04m7VFgHxX1YDS2bFVrYqHP1_CfG38xC7AABaXxpj0ybntqjaCcTimDbZdFLxcp6EPgOL-rnbWvs1MW8vIbRDEPf9weGE1eqjnTRY4hkJCOXVrjjO--nADNU Jun 06 10:31:31.436080 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: X-Domain-Id: None Jun 06 10:31:31.436080 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: X-Domain-Name: None Jun 06 10:31:31.436080 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: X-Identity-Status: Confirmed Jun 06 10:31:31.436080 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: X-Is-Admin-Project: True Jun 06 10:31:31.436080 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: X-Openstack-Nova-Api-Version: 2.90 Jun 06 10:31:31.436080 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: X-Project-Domain-Id: default Jun 06 10:31:31.436080 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: X-Project-Domain-Name: Default Jun 06 10:31:31.436080 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: X-Project-Id: 863195bccbf14e04a9a61a90f52ba9f1 Jun 06 10:31:31.436080 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: X-Project-Name: admin Jun 06 10:31:31.436080 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: X-Role: reader,member,admin Jun 06 10:31:31.436080 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: X-Roles: reader,member,admin Jun 06 10:31:31.437577 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/863195bccbf14e04a9a61a90f52ba9f1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/863195bccbf14e04a9a61a90f52ba9f1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/863195bccbf14e04a9a61a90f52ba9f1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_863195bccbf14e04a9a61a90f52ba9f1", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Jun 06 10:31:31.437577 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: X-Tenant: admin Jun 06 10:31:31.437577 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: X-Tenant-Id: 863195bccbf14e04a9a61a90f52ba9f1 Jun 06 10:31:31.437577 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: X-Tenant-Name: admin Jun 06 10:31:31.437577 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: X-User: admin Jun 06 10:31:31.437577 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: X-User-Domain-Id: default Jun 06 10:31:31.437577 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: X-User-Domain-Name: Default Jun 06 10:31:31.437577 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: X-User-Id: dc953d765b8048419427028bb5821273 Jun 06 10:31:31.437577 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: X-User-Name: admin Jun 06 10:31:31.437577 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: method: > Jun 06 10:31:31.437577 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: exception: Flavor 451 could not be found. Jun 06 10:31:31.437577 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: action_args: {'id': '451'} Jun 06 10:31:31.437577 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: {{(pid=103360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 10:31:31.437577 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 10:31:31.438478 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 06 10:31:31.438478 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 06 10:31:31.438478 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 06 10:31:31.438478 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 06 10:31:31.438478 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 06 10:31:31.438478 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 06 10:31:31.438478 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 06 10:31:31.438478 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 06 10:31:31.438478 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 06 10:31:31.438478 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 10:31:31.438478 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 06 10:31:31.438478 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 06 10:31:31.438478 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 06 10:31:31.438478 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi Jun 06 10:31:31.438478 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 10:31:31.438478 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi Jun 06 10:31:31.438478 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 10:31:31.438478 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 10:31:31.438478 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 10:31:31.440101 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 10:31:31.440101 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 10:31:31.440101 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 10:31:31.440101 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 10:31:31.440101 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 06 10:31:31.440101 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 06 10:31:31.440101 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 06 10:31:31.440101 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi Jun 06 10:31:31.440101 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 10:31:31.440101 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi Jun 06 10:31:31.440101 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 10:31:31.440101 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 10:31:31.440101 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 10:31:31.440101 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 10:31:31.440101 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 10:31:31.440101 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 06 10:31:31.440101 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi Jun 06 10:31:31.440101 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi [None req-f0c371a9-5235-485a-bc03-9c93ce88cd55 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 10:31:31.441355 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: INFO nova.api.openstack.requestlog [None req-f0c371a9-5235-485a-bc03-9c93ce88cd55 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.011668 Jun 06 10:31:31.441355 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: [pid: 103360|app: 0|req: 27/52] 10.222.0.42 () {60 vars in 1193 bytes} [Mon Jun 6 10:31:31 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 06 10:31:32.304962 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi [None req-334896e9-612f-4f41-8c0f-9c37edbd6bfa admin admin] Calling method '>' {{(pid=103361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:31:32.305952 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: INFO nova.api.openstack.requestlog [None req-334896e9-612f-4f41-8c0f-9c37edbd6bfa admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001402 Jun 06 10:31:32.306332 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: [pid: 103361|app: 0|req: 26/53] 10.222.0.42 () {56 vars in 1074 bytes} [Mon Jun 6 10:31:32 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 10:31:32.497688 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi [None req-eb431d25-a41d-4e40-b474-4447a0583293 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 10:31:32.515190 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: INFO nova.api.openstack.requestlog [None req-eb431d25-a41d-4e40-b474-4447a0583293 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.068644 Jun 06 10:31:32.515741 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: [pid: 103360|app: 0|req: 28/54] 10.222.0.42 () {64 vars in 1235 bytes} [Mon Jun 6 10:31:32 2022] POST /compute/v2.1/flavors => generated 404 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 06 10:31:33.389717 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi [None req-334896e9-612f-4f41-8c0f-9c37edbd6bfa admin admin] Calling method '>' {{(pid=103361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:31:33.390716 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: INFO nova.api.openstack.requestlog [None req-334896e9-612f-4f41-8c0f-9c37edbd6bfa admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001460 Jun 06 10:31:33.391106 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: [pid: 103361|app: 0|req: 27/55] 10.222.0.42 () {56 vars in 1074 bytes} [Mon Jun 6 10:31:33 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 10:31:33.583312 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi [None req-09da120a-0125-4e1e-9e97-10cb6dc5ebea admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 10:31:33.601428 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: INFO nova.api.openstack.requestlog [None req-09da120a-0125-4e1e-9e97-10cb6dc5ebea admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.069731 Jun 06 10:31:33.601909 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: [pid: 103360|app: 0|req: 29/56] 10.222.0.42 () {64 vars in 1235 bytes} [Mon Jun 6 10:31:33 2022] POST /compute/v2.1/flavors => generated 405 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 06 10:31:34.474665 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi [None req-334896e9-612f-4f41-8c0f-9c37edbd6bfa admin admin] Calling method '>' {{(pid=103361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:31:34.475653 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: INFO nova.api.openstack.requestlog [None req-334896e9-612f-4f41-8c0f-9c37edbd6bfa admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001387 Jun 06 10:31:34.476069 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: [pid: 103361|app: 0|req: 28/57] 10.222.0.42 () {56 vars in 1074 bytes} [Mon Jun 6 10:31:34 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 10:31:34.666071 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi [None req-d9499f2f-4e6f-4694-a514-93421a8a7fe5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 10:31:34.683348 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: INFO nova.api.openstack.requestlog [None req-d9499f2f-4e6f-4694-a514-93421a8a7fe5 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.069821 Jun 06 10:31:34.683922 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: [pid: 103360|app: 0|req: 30/58] 10.222.0.42 () {64 vars in 1235 bytes} [Mon Jun 6 10:31:34 2022] POST /compute/v2.1/flavors => generated 407 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 06 10:31:35.562926 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi [None req-334896e9-612f-4f41-8c0f-9c37edbd6bfa admin admin] Calling method '>' {{(pid=103361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:31:35.564141 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: INFO nova.api.openstack.requestlog [None req-334896e9-612f-4f41-8c0f-9c37edbd6bfa admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001595 Jun 06 10:31:35.564530 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: [pid: 103361|app: 0|req: 29/59] 10.222.0.42 () {56 vars in 1074 bytes} [Mon Jun 6 10:31:35 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 10:31:35.751642 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi [None req-b45270e9-7c71-4b42-98a3-1d72bba114d9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 10:31:35.769768 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: INFO nova.api.openstack.requestlog [None req-b45270e9-7c71-4b42-98a3-1d72bba114d9 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.069103 Jun 06 10:31:35.770308 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: [pid: 103360|app: 0|req: 31/60] 10.222.0.42 () {64 vars in 1235 bytes} [Mon Jun 6 10:31:35 2022] POST /compute/v2.1/flavors => generated 409 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 06 10:31:36.661026 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi [None req-334896e9-612f-4f41-8c0f-9c37edbd6bfa admin admin] Calling method '>' {{(pid=103361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:31:36.662027 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: INFO nova.api.openstack.requestlog [None req-334896e9-612f-4f41-8c0f-9c37edbd6bfa admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001409 Jun 06 10:31:36.662423 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: [pid: 103361|app: 0|req: 30/61] 10.222.0.42 () {56 vars in 1074 bytes} [Mon Jun 6 10:31:36 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 10:31:36.854314 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi [None req-3f64b049-8186-4849-8adb-5d7d570d1c90 admin admin] Calling method '>' {{(pid=103360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:31:36.873838 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: INFO nova.api.openstack.requestlog [None req-3f64b049-8186-4849-8adb-5d7d570d1c90 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.070794 Jun 06 10:31:36.874365 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: [pid: 103360|app: 0|req: 32/62] 10.222.0.42 () {60 vars in 1202 bytes} [Mon Jun 6 10:31:36 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 10:32:38.494285 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi [None req-334896e9-612f-4f41-8c0f-9c37edbd6bfa admin admin] Calling method '>' {{(pid=103361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:32:38.495285 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: INFO nova.api.openstack.requestlog [None req-334896e9-612f-4f41-8c0f-9c37edbd6bfa admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001424 Jun 06 10:32:38.495684 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: [pid: 103361|app: 0|req: 31/63] 10.222.0.42 () {54 vars in 930 bytes} [Mon Jun 6 10:32:38 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 10:32:38.503697 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG dbcounter [-] [103360] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 10:32:38.555050 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi [None req-a78385a1-63d0-4c4c-8496-c4a49b09daef admin admin] Calling method '>' {{(pid=103360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:32:38.574843 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: INFO nova.api.openstack.requestlog [None req-a78385a1-63d0-4c4c-8496-c4a49b09daef admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.072547 Jun 06 10:32:38.575368 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: [pid: 103360|app: 0|req: 33/64] 10.222.0.42 () {60 vars in 1291 bytes} [Mon Jun 6 10:32:38 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 10:32:38.600388 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi [None req-b47851ce-bdb0-47c6-af90-f4a60e00985d admin admin] Calling method '>' {{(pid=103361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:32:38.605818 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG dbcounter [-] [103361] Writing DB stats nova_api:SELECT=14 {{(pid=103361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 10:32:38.613943 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: INFO nova.api.openstack.requestlog [None req-b47851ce-bdb0-47c6-af90-f4a60e00985d admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.019631 Jun 06 10:32:38.615273 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: [pid: 103361|app: 0|req: 32/65] 10.222.0.42 () {60 vars in 1282 bytes} [Mon Jun 6 10:32:38 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:32:38.629857 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi [None req-b88537c6-106c-482e-ba0c-94efcdf80cb8 admin admin] Calling method '>' {{(pid=103360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:32:38.641638 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: INFO nova.api.openstack.requestlog [None req-b88537c6-106c-482e-ba0c-94efcdf80cb8 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.017970 Jun 06 10:32:38.642407 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: [pid: 103360|app: 0|req: 34/66] 10.222.0.42 () {60 vars in 1285 bytes} [Mon Jun 6 10:32:38 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 10:32:38.654591 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi [None req-c16832ad-59f6-44b8-801d-c1d52c21bf5f admin admin] Calling method '>' {{(pid=103361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:32:38.663830 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: INFO nova.api.openstack.requestlog [None req-c16832ad-59f6-44b8-801d-c1d52c21bf5f admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013132 Jun 06 10:32:38.664726 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: [pid: 103361|app: 0|req: 33/67] 10.222.0.42 () {60 vars in 1285 bytes} [Mon Jun 6 10:32:38 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:32:38.677382 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi [None req-4bc0e6f9-d905-47b0-8de2-9e9c10070829 admin admin] Calling method '>' {{(pid=103360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:32:38.685952 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: INFO nova.api.openstack.requestlog [None req-4bc0e6f9-d905-47b0-8de2-9e9c10070829 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012363 Jun 06 10:32:38.686493 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: [pid: 103360|app: 0|req: 35/68] 10.222.0.42 () {60 vars in 1282 bytes} [Mon Jun 6 10:32:38 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:35:59.521861 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi [None req-c16832ad-59f6-44b8-801d-c1d52c21bf5f admin admin] Calling method '>' {{(pid=103361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:35:59.524116 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: INFO nova.api.openstack.requestlog [None req-c16832ad-59f6-44b8-801d-c1d52c21bf5f admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002767 Jun 06 10:35:59.524802 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: [pid: 103361|app: 0|req: 34/69] 10.222.0.42 () {56 vars in 1074 bytes} [Mon Jun 6 10:35:59 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 10:35:59.684823 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG dbcounter [-] [103360] Writing DB stats nova_api:SELECT=6 {{(pid=103360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 10:35:59.800466 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi [None req-ee74af20-a266-417a-9fd2-ff6d1ccd090b admin admin] Calling method '>' {{(pid=103360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:35:59.801827 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 06 10:35:59.801827 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: warnings.warn(msg) Jun 06 10:35:59.803255 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG oslo_concurrency.lockutils [None req-ee74af20-a266-417a-9fd2-ff6d1ccd090b admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:35:59.803740 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG oslo_concurrency.lockutils [None req-ee74af20-a266-417a-9fd2-ff6d1ccd090b admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:35:59.804594 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG oslo_concurrency.lockutils [None req-ee74af20-a266-417a-9fd2-ff6d1ccd090b admin admin] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:35:59.805025 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG oslo_concurrency.lockutils [None req-ee74af20-a266-417a-9fd2-ff6d1ccd090b admin admin] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:35:59.840122 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: INFO nova.api.openstack.requestlog [None req-ee74af20-a266-417a-9fd2-ff6d1ccd090b admin admin] 10.222.0.42 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.156915 Jun 06 10:35:59.840686 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: [pid: 103360|app: 0|req: 36/70] 10.222.0.42 () {60 vars in 1193 bytes} [Mon Jun 6 10:35:59 2022] GET /compute/v2.1/os-services => generated 791 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 06 10:36:00.713217 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi [None req-c16832ad-59f6-44b8-801d-c1d52c21bf5f admin admin] Calling method '>' {{(pid=103361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:36:00.714241 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: INFO nova.api.openstack.requestlog [None req-c16832ad-59f6-44b8-801d-c1d52c21bf5f admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001425 Jun 06 10:36:00.714628 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: [pid: 103361|app: 0|req: 35/71] 10.222.0.42 () {56 vars in 1074 bytes} [Mon Jun 6 10:36:00 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 10:36:00.906593 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi [None req-c8fac9fa-1381-4497-816f-49762cb3bc9f admin admin] Calling method '>' {{(pid=103360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:36:00.907768 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 06 10:36:00.907768 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: warnings.warn(msg) Jun 06 10:36:00.908970 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG oslo_concurrency.lockutils [None req-c8fac9fa-1381-4497-816f-49762cb3bc9f admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:36:00.909415 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG oslo_concurrency.lockutils [None req-c8fac9fa-1381-4497-816f-49762cb3bc9f admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:36:00.910202 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG oslo_concurrency.lockutils [None req-c8fac9fa-1381-4497-816f-49762cb3bc9f admin admin] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:36:00.910642 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG oslo_concurrency.lockutils [None req-c8fac9fa-1381-4497-816f-49762cb3bc9f admin admin] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:36:00.930370 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: INFO nova.api.openstack.requestlog [None req-c8fac9fa-1381-4497-816f-49762cb3bc9f admin admin] 10.222.0.42 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.075622 Jun 06 10:36:00.930877 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: [pid: 103360|app: 0|req: 37/72] 10.222.0.42 () {60 vars in 1193 bytes} [Mon Jun 6 10:36:00 2022] GET /compute/v2.1/os-services => generated 791 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 06 10:36:12.206366 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi [None req-c16832ad-59f6-44b8-801d-c1d52c21bf5f admin admin] Calling method '>' {{(pid=103361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:36:12.207498 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: INFO nova.api.openstack.requestlog [None req-c16832ad-59f6-44b8-801d-c1d52c21bf5f admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002046 Jun 06 10:36:12.207925 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: [pid: 103361|app: 0|req: 36/73] 10.222.0.42 () {56 vars in 1074 bytes} [Mon Jun 6 10:36:12 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 10:36:12.352971 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG dbcounter [-] [103360] Writing DB stats nova_cell0:SELECT=4 {{(pid=103360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 10:36:12.353687 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG dbcounter [-] [103360] Writing DB stats nova_cell1:SELECT=4 {{(pid=103360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 10:36:12.354305 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG dbcounter [-] [103360] Writing DB stats nova_api:SELECT=8 {{(pid=103360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 10:36:12.404995 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi [None req-836a3302-9898-4fbf-ab65-b973c67ff4fa admin admin] Calling method '>' {{(pid=103360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:36:12.406224 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 06 10:36:12.406224 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: warnings.warn(msg) Jun 06 10:36:12.407396 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG oslo_concurrency.lockutils [None req-836a3302-9898-4fbf-ab65-b973c67ff4fa admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:36:12.407875 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG oslo_concurrency.lockutils [None req-836a3302-9898-4fbf-ab65-b973c67ff4fa admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:36:12.408836 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG oslo_concurrency.lockutils [None req-836a3302-9898-4fbf-ab65-b973c67ff4fa admin admin] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:36:12.409265 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG oslo_concurrency.lockutils [None req-836a3302-9898-4fbf-ab65-b973c67ff4fa admin admin] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:36:12.433452 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: INFO nova.api.openstack.requestlog [None req-836a3302-9898-4fbf-ab65-b973c67ff4fa admin admin] 10.222.0.42 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.084959 Jun 06 10:36:12.434014 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: [pid: 103360|app: 0|req: 38/74] 10.222.0.42 () {60 vars in 1193 bytes} [Mon Jun 6 10:36:12 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 10:36:13.311071 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi [None req-c16832ad-59f6-44b8-801d-c1d52c21bf5f admin admin] Calling method '>' {{(pid=103361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:36:13.312114 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: INFO nova.api.openstack.requestlog [None req-c16832ad-59f6-44b8-801d-c1d52c21bf5f admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001414 Jun 06 10:36:13.312509 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: [pid: 103361|app: 0|req: 37/75] 10.222.0.42 () {56 vars in 1074 bytes} [Mon Jun 6 10:36:13 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 10:36:13.502234 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi [None req-819cfc52-83b9-4413-a930-1342bc12ffbf admin admin] Calling method '>' {{(pid=103360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:36:13.503444 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 06 10:36:13.503444 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: warnings.warn(msg) Jun 06 10:36:13.504644 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG oslo_concurrency.lockutils [None req-819cfc52-83b9-4413-a930-1342bc12ffbf admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:36:13.505082 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG oslo_concurrency.lockutils [None req-819cfc52-83b9-4413-a930-1342bc12ffbf admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:36:13.505883 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG oslo_concurrency.lockutils [None req-819cfc52-83b9-4413-a930-1342bc12ffbf admin admin] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:36:13.506914 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: DEBUG oslo_concurrency.lockutils [None req-819cfc52-83b9-4413-a930-1342bc12ffbf admin admin] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:36:13.529678 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: INFO nova.api.openstack.requestlog [None req-819cfc52-83b9-4413-a930-1342bc12ffbf admin admin] 10.222.0.42 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.078665 Jun 06 10:36:13.530160 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: [pid: 103360|app: 0|req: 39/76] 10.222.0.42 () {60 vars in 1193 bytes} [Mon Jun 6 10:36:13 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 10:37:11.813486 dv-cinder-844822-1-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jun 06 10:37:11.814054 dv-cinder-844822-1-iscsi devstack@n-api.service[103359]: Mon Jun 6 10:37:11 2022 - graceful shutdown triggered... Jun 06 10:37:11.814553 dv-cinder-844822-1-iscsi devstack@n-api.service[103360]: Gracefully killing worker 1 (pid: 103360)... Jun 06 10:37:11.815498 dv-cinder-844822-1-iscsi devstack@n-api.service[103361]: Gracefully killing worker 2 (pid: 103361)... Jun 06 10:37:12.815771 dv-cinder-844822-1-iscsi devstack@n-api.service[103359]: worker 1 buried after 1 seconds Jun 06 10:37:12.816322 dv-cinder-844822-1-iscsi devstack@n-api.service[103359]: worker 2 buried after 1 seconds Jun 06 10:37:12.816322 dv-cinder-844822-1-iscsi devstack@n-api.service[103359]: goodbye to uWSGI. Jun 06 10:37:12.817397 dv-cinder-844822-1-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jun 06 10:37:12.817960 dv-cinder-844822-1-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jun 06 10:37:12.820729 dv-cinder-844822-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jun 06 10:37:12.838818 dv-cinder-844822-1-iscsi devstack@n-api.service[129331]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 06 10:37:12.855643 dv-cinder-844822-1-iscsi devstack@n-api.service[129331]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Jun 6 10:37:12 2022] *** Jun 06 10:37:12.855643 dv-cinder-844822-1-iscsi devstack@n-api.service[129331]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 06 10:37:12.855643 dv-cinder-844822-1-iscsi devstack@n-api.service[129331]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 06 10:37:12.855643 dv-cinder-844822-1-iscsi devstack@n-api.service[129331]: nodename: dv-cinder-844822-1-iscsi Jun 06 10:37:12.855643 dv-cinder-844822-1-iscsi devstack@n-api.service[129331]: machine: x86_64 Jun 06 10:37:12.855643 dv-cinder-844822-1-iscsi devstack@n-api.service[129331]: clock source: unix Jun 06 10:37:12.855643 dv-cinder-844822-1-iscsi devstack@n-api.service[129331]: pcre jit disabled Jun 06 10:37:12.855643 dv-cinder-844822-1-iscsi devstack@n-api.service[129331]: detected number of CPU cores: 4 Jun 06 10:37:12.855643 dv-cinder-844822-1-iscsi devstack@n-api.service[129331]: current working directory: / Jun 06 10:37:12.855643 dv-cinder-844822-1-iscsi devstack@n-api.service[129331]: detected binary path: /usr/bin/uwsgi-core Jun 06 10:37:12.856467 dv-cinder-844822-1-iscsi devstack@n-api.service[129331]: your processes number limit is 47680 Jun 06 10:37:12.856467 dv-cinder-844822-1-iscsi devstack@n-api.service[129331]: your memory page size is 4096 bytes Jun 06 10:37:12.856467 dv-cinder-844822-1-iscsi devstack@n-api.service[129331]: detected max file descriptor number: 2048 Jun 06 10:37:12.856467 dv-cinder-844822-1-iscsi devstack@n-api.service[129331]: lock engine: pthread robust mutexes Jun 06 10:37:12.856467 dv-cinder-844822-1-iscsi devstack@n-api.service[129331]: thunder lock: enabled Jun 06 10:37:12.856467 dv-cinder-844822-1-iscsi devstack@n-api.service[129331]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 06 10:37:12.856467 dv-cinder-844822-1-iscsi devstack@n-api.service[129331]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 06 10:37:12.904273 dv-cinder-844822-1-iscsi devstack@n-api.service[129331]: Python main interpreter initialized at 0x5650c9cf79c0 Jun 06 10:37:12.904273 dv-cinder-844822-1-iscsi devstack@n-api.service[129331]: python threads support enabled Jun 06 10:37:12.904273 dv-cinder-844822-1-iscsi devstack@n-api.service[129331]: your server socket listen backlog is limited to 100 connections Jun 06 10:37:12.904273 dv-cinder-844822-1-iscsi devstack@n-api.service[129331]: your mercy for graceful operations on workers is 90 seconds Jun 06 10:37:12.904674 dv-cinder-844822-1-iscsi devstack@n-api.service[129331]: mapped 403077 bytes (393 KB) for 2 cores Jun 06 10:37:12.904745 dv-cinder-844822-1-iscsi devstack@n-api.service[129331]: *** Operational MODE: preforking *** Jun 06 10:37:12.905016 dv-cinder-844822-1-iscsi devstack@n-api.service[129331]: *** uWSGI is running in multiple interpreter mode *** Jun 06 10:37:12.905016 dv-cinder-844822-1-iscsi devstack@n-api.service[129331]: spawned uWSGI master process (pid: 129331) Jun 06 10:37:12.905220 dv-cinder-844822-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jun 06 10:37:12.905995 dv-cinder-844822-1-iscsi devstack@n-api.service[129331]: spawned uWSGI worker 1 (pid: 129349, cores: 1) Jun 06 10:37:12.906180 dv-cinder-844822-1-iscsi devstack@n-api.service[129331]: spawned uWSGI worker 2 (pid: 129350, cores: 1) Jun 06 10:37:12.906346 dv-cinder-844822-1-iscsi devstack@n-api.service[129331]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 06 10:37:14.148223 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 06 10:37:14.167010 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 06 10:37:15.009116 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 06 10:37:15.009116 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: from cryptography.utils import int_from_bytes Jun 06 10:37:15.009468 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 06 10:37:15.009468 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: from cryptography.utils import int_from_bytes Jun 06 10:37:15.016402 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 06 10:37:15.016402 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: from cryptography.utils import int_from_bytes Jun 06 10:37:15.016748 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 06 10:37:15.016748 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: from cryptography.utils import int_from_bytes Jun 06 10:37:17.450213 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 06 10:37:17.450867 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 06 10:37:17.450966 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 06 10:37:17.451329 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 06 10:37:17.451580 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 06 10:37:17.451992 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:37:17.452318 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:37:17.452638 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:37:17.452957 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:37:17.453288 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:37:17.453598 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:37:17.453917 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:37:17.454236 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:37:17.454562 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:37:17.454819 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:37:17.455689 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:37:17.456040 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 06 10:37:17.456431 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-844822-1-iscsi {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:37:17.456521 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 06 10:37:17.456604 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:37:17.456715 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:37:17.456809 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 06 10:37:17.456953 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:37:17.457170 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 06 10:37:17.457280 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:37:17.457426 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 06 10:37:17.457559 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:37:17.457814 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:37:17.457917 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:37:17.458142 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:37:17.458240 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:37:17.458467 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:37:17.458654 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:37:17.458788 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:37:17.459105 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:37:17.459221 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:37:17.459413 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:37:17.459535 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:37:17.459722 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:37:17.459924 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:37:17.460095 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:37:17.460203 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:37:17.460378 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:37:17.460492 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:37:17.460639 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:37:17.460732 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:37:17.460956 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:37:17.461054 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:37:17.461280 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-844822-1-iscsi {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:37:17.461402 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:37:17.461597 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:37:17.461716 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:37:17.461913 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:37:17.462010 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:37:17.462211 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:37:17.462304 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-844822-1-iscsi {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:37:17.462530 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:37:17.462622 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:37:17.462835 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:37:17.462939 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:37:17.463159 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:37:17.463266 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:37:17.463468 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:37:17.463580 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:37:17.463902 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:37:17.464017 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:37:17.464212 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:37:17.464320 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:37:17.464534 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:37:17.464667 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:37:17.464854 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:37:17.464967 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:37:17.465161 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:37:17.465278 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:37:17.465485 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:37:17.465596 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:37:17.465802 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:37:17.465924 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:37:17.466117 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:37:17.466224 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:37:17.466424 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:37:17.466539 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:37:17.466722 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:37:17.466815 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:37:17.467030 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:37:17.467142 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:37:17.467336 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:37:17.467450 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-844822-1-iscsi {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:37:17.467652 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:37:17.467766 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:37:17.467960 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:37:17.468045 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:37:17.468272 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:37:17.468391 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:37:17.468518 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:37:17.468759 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:37:17.468852 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:37:17.469072 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:37:17.469187 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:37:17.469383 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:37:17.469485 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:37:17.469703 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:37:17.469796 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:37:17.469964 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:37:17.470067 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:37:17.470210 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:37:17.470305 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:37:17.470530 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:37:17.471308 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:37:17.471464 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:37:17.471596 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:37:17.471881 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:37:17.472000 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:37:17.472205 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:37:17.472297 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:37:17.472510 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:37:17.472615 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:37:17.472821 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:37:17.472922 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:37:17.473131 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:37:17.473237 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:37:17.473436 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:37:17.473541 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:37:17.473746 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:37:17.473852 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:37:17.474047 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:37:17.474153 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:37:17.474299 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:37:17.474397 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:37:17.474616 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:37:17.474714 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:37:17.474941 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:37:17.475055 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:37:17.475261 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:37:17.475361 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:37:17.475578 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:37:17.475669 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:37:17.475848 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:37:17.475996 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.42 {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:37:17.476099 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:37:17.476247 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.42 {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:37:17.476407 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:37:17.476558 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:37:17.476728 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:37:17.476896 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:37:17.477039 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:37:17.477211 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:37:17.477349 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:37:17.477518 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:37:17.477660 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:37:17.477835 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:37:17.477969 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:37:17.478154 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:37:17.478278 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:37:17.478460 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:37:17.478588 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:37:17.478766 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:37:17.478898 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:37:17.479073 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:37:17.479208 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:37:17.479391 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:37:17.479526 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:37:17.479724 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:37:17.479871 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:37:17.480053 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:37:17.480197 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:37:17.480303 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:37:17.480508 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:37:17.480600 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:37:17.480832 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:37:17.480933 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:37:17.481185 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:37:17.481359 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.42 {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:37:17.481462 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.42 {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:37:17.481546 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:37:17.481767 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:37:17.481885 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:37:17.482070 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:37:17.482171 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:37:17.482368 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:37:17.482469 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:37:17.482672 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:37:17.482772 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:37:17.482976 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:37:17.483069 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:37:17.483280 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:37:17.483382 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:37:17.483584 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:37:17.483683 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:37:17.483912 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:37:17.484013 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:37:17.484197 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:37:17.484303 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:37:17.484502 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:37:17.484603 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:37:17.484804 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:37:17.484926 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:37:17.485105 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:37:17.485206 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:37:17.485410 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:37:17.485500 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:37:17.485714 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:37:17.485814 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:37:17.486018 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:37:17.486117 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:37:17.486361 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:37:17.486474 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:37:17.486794 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:37:17.486896 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:37:17.487099 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:37:17.487204 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:37:17.487417 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:37:17.487507 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:37:17.487720 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:37:17.487850 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:37:17.488053 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:37:17.488193 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:37:17.488361 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:37:17.488502 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:37:17.488664 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:37:17.488758 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:37:17.488968 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:37:17.489070 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:37:17.489274 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:37:17.489374 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:37:17.489578 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:37:17.489681 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:37:17.489884 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:37:17.489976 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:37:17.490192 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:37:17.490284 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:37:17.490489 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:37:17.490581 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:37:17.490801 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:37:17.490903 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:37:17.491113 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:37:17.491207 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:37:17.491419 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:37:17.491526 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:37:17.491723 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:37:17.491918 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:37:17.492052 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:37:17.492154 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:37:17.492356 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:37:17.492459 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:37:17.492657 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:37:17.492750 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:37:17.492960 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:37:17.493053 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:37:17.493260 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:37:17.493352 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:37:17.493561 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:37:17.493652 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:37:17.493858 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:37:17.493973 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:37:17.494164 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:37:17.494275 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:37:17.494478 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:37:17.494578 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:37:17.494784 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:37:17.494933 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:37:17.495090 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:37:17.495225 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:37:17.495391 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:37:17.495493 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:37:17.495695 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:37:17.495808 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:37:17.496029 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:37:17.496119 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.496343 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:37:17.496456 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.496652 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:37:17.496759 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.496957 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:37:17.497049 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.497259 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:37:17.497360 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.497565 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:37:17.497665 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.497869 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:37:17.497961 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.498184 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:37:17.498298 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.498476 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:37:17.498569 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.498781 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:37:17.498876 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.499080 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:37:17.499185 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.499395 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:37:17.499488 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.499718 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:37:17.499856 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.500055 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:37:17.500149 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.500365 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:37:17.500466 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.500672 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:37:17.500767 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.500991 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 10:37:17.501092 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.501328 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.501429 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.501659 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.501752 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.502115 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.502266 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.502447 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.502591 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.502774 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.502882 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.503097 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.503189 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.503408 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.503516 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.503808 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.503956 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.504149 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.504254 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.504465 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.504590 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.504782 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.504876 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.505100 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.505219 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.505422 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.505518 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.505795 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.505911 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.506032 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.506128 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.506357 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.506472 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.506673 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.506773 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.506985 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.507081 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.507304 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.507410 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.507616 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.507719 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.507954 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.508051 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.508267 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.508369 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.508579 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.508706 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.508891 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.509000 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.509220 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.509313 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.509535 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.509642 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.509853 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.509955 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.510168 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.510270 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.510485 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.510593 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.510799 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.510893 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.511107 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.511207 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.511416 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.511519 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.511720 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.511837 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.512051 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.512168 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.512357 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.512522 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.512678 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.512824 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.512964 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.513115 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.513268 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.513432 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.513576 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.513725 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.513868 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.514011 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.514183 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.514329 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.514546 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.514683 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.514826 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.514968 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.515198 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.515372 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.515520 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.515677 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.515856 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.515971 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.516065 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.516158 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.516295 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.516388 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.516601 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.516709 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.516924 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.517026 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.517235 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.517328 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.518078 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.518220 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.518393 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.518621 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.518728 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.518837 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.518993 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.519131 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.519308 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.519421 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.519621 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.519909 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.520027 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.520118 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.520255 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.520378 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.520567 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.520669 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.520881 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.520973 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.521196 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.521290 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.521761 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.521869 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.522087 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.522176 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.522403 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.522489 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.522711 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.522811 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.523035 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.523127 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.523349 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.523449 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.523659 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.523761 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.523987 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.524079 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.524298 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.524403 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.524603 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.524756 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.524907 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.524999 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.525216 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.525331 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.525523 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.525631 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.525827 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.525922 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.526131 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.526225 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.526436 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.526545 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.526744 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.526913 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.527061 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.527204 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.527353 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.527501 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.527643 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.527814 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.527966 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.528119 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.528275 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.528424 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.528566 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.528705 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.528867 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.529044 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.529193 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.529345 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.529487 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.529636 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.529821 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.529974 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.530126 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.530273 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.530415 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.530553 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.530723 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.530879 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.531025 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.531168 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.531306 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.531452 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.531594 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.531743 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.531928 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.532031 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.532235 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.532327 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.532558 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.532659 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.532870 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.532961 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.533716 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.533985 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.534077 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.534173 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.534334 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.534434 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.534678 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.534774 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.534987 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.535087 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.535337 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.535463 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.535655 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.535760 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.536006 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.536109 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.536332 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.536434 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.536648 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.536739 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.536967 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.537123 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.537270 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.537421 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.537570 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.537712 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.537863 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.538004 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.538172 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.538319 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.538472 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.538629 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.538777 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.538917 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.539091 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.539231 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.539402 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.539552 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.539702 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.539866 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.540042 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.540134 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.540368 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.540472 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.540674 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.540766 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.540990 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.541081 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.541303 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.541404 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.541618 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.541718 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.541945 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.542038 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.542270 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.542377 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.542579 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.542670 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.542892 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.542984 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.543202 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.543301 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.543511 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.543604 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.543842 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.543939 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.544157 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.544251 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.544463 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.544554 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.544770 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.544858 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.545081 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.545182 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.545403 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.545492 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.545707 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.545832 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.546017 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.546125 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.546320 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.546435 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.546632 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.546745 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.546938 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.547067 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.547243 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.547353 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.547547 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.547663 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.547878 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.547983 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.548202 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.548315 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.548514 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.548627 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.548850 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.549027 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.549168 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.549500 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.549600 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.549828 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.549930 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.550141 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.550242 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.550456 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.550550 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.550775 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.550869 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.551089 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.551191 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.551401 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.551508 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.551710 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.551838 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.552055 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.552149 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.552366 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.552468 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.552677 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.552768 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.552985 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.553088 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.553300 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.553406 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.553610 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.553709 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.553929 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.554028 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.554239 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.554341 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.554553 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.554646 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.554858 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.554986 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.555174 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.555268 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.555481 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.555617 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.555883 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.556014 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.556115 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.556198 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.556414 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.556516 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.556721 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.556814 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.557054 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.557154 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.557355 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.557454 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.557666 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.557774 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.557977 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.558070 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.558284 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.558386 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.558596 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.558699 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.558911 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.559002 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.559226 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.559490 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.559659 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.559857 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.559952 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.560149 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.560251 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.560470 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.560571 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.560786 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.560904 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.561102 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.561196 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.561416 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.561562 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.561732 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.561834 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.562057 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.562160 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.562370 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.562473 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.562679 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.562782 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.562987 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.563089 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.563292 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.563392 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.563600 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.563692 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.563929 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.564039 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.564236 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.565029 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.565275 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.565501 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.565677 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.565773 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.565994 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.566113 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.566311 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.566429 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.566623 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.566736 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.566933 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.567045 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.567256 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.567367 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.567567 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.567670 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.567908 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.568102 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.568202 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.568289 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.568522 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.568625 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.568833 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.568941 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.569137 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.569246 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.569443 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.569554 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.569751 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.569862 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.570054 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.570156 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.570368 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.570471 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.570678 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.570780 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.570988 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.571082 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.571295 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.571395 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.571601 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.571712 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.571944 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.572042 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.572254 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.572349 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.572569 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.572679 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.572877 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.572978 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.573183 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.573285 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.573493 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.573595 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.573798 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.573891 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.574101 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.574268 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.574408 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.574502 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.574718 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.574811 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.575148 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.575304 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.575420 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.575577 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.575692 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.575874 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.575973 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.576071 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.576239 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.576365 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.576554 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.576699 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.576866 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.576991 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.577171 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.577301 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.577476 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.577611 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.577787 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.577920 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.578096 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.578235 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.578399 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.578547 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.578710 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.578854 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.579014 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.579169 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.579329 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.579485 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.579634 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.579815 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.580047 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.580735 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.580857 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.581078 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.581192 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.581468 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.581569 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.581779 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.581871 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.582096 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.582196 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.582407 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.582506 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.582711 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.582857 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.583017 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.583111 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.583327 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.583430 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.583629 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.583730 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.583958 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.584067 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.584268 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.584368 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.584573 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.584673 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.584893 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.584996 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.585262 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.585407 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.585507 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.585610 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.585804 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.585923 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.586110 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.586228 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.586416 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.586533 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.586724 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.586843 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.587021 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.587116 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.587327 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.587437 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.587632 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.587728 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.587960 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.588058 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.588264 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.588372 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.588569 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.588660 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.588879 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.588972 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.589184 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.589279 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.589490 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.589593 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.589794 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.589889 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.590108 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.590208 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.590421 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.590515 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.590729 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.590823 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.591040 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.591134 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.591348 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.591441 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.591661 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.591754 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.591992 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.592097 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.592301 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.592393 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.592606 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.592709 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.592910 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.593002 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.593213 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.593341 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.593523 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.593631 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.593836 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.593939 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.594138 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.594230 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.594442 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.594545 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.594745 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.594837 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.595062 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.595156 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.595379 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.595507 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.595811 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.595917 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.596189 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.596284 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.596556 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.596669 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.596883 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.597039 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.597186 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.597328 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.597486 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.597636 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.597808 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.597959 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.598111 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.598263 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.598431 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.598572 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.598713 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.598854 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.599009 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.599158 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.599309 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.599459 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.599600 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.599740 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.599943 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.600037 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.600252 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.600348 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.600565 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.600659 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.600877 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.600984 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.601183 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.601277 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.601508 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.601610 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.601818 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.601918 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.602119 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.602218 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.602430 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.602532 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.602738 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.602841 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.603048 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.603148 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.603350 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.603498 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.603664 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.603888 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.604019 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.604123 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.604337 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.604441 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.604654 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.604756 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.604970 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.605072 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.605279 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.605380 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.605605 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.605703 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.605896 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.606002 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.606206 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.606313 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.606532 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.606673 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.606854 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.606946 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.607139 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.607243 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.607451 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.607546 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.607758 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.607912 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.608101 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.608205 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.608410 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.608512 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.608731 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.608825 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.609040 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.609142 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.609345 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.609439 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.609650 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.609744 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.609972 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.610127 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.610279 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.610380 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.610598 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.610700 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.610953 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.611058 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.611285 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.611384 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.611709 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.611831 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.612055 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.612250 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.612371 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.612566 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.612688 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.612879 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.612982 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.613202 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.613306 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.613523 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.613625 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.613848 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.613951 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.614153 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.614254 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.614467 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.614560 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.614777 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.614880 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.615098 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.615192 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.615412 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.615511 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.615720 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.615847 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.616062 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.616157 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.616369 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.616482 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.616688 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.616956 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.617048 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.617186 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.617296 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.617469 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.617613 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.617783 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.618027 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.618129 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.618350 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.618448 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.618663 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.618765 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.618984 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.619086 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.619309 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.619404 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.619614 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.619707 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.619963 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.620070 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.620289 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.620394 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.620605 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.620698 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.620909 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.621011 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.621216 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.621308 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.621527 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.621629 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.621839 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.621946 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.622150 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.622245 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.622460 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.622562 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.622764 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.622873 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.623069 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.623171 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.623392 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.623490 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.623697 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.623821 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.624049 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.624145 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.624362 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.624464 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.624683 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.624778 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.625003 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.625106 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.625308 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.625410 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.625617 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.625750 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.625926 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.626019 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.626230 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.626324 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.626538 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.626645 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.627368 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.627512 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.627681 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.627817 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.628014 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.628124 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.628324 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.628441 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.628650 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.628776 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.628958 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.629107 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.629282 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.629420 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.629597 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.629754 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.629920 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.630081 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.630242 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.630400 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.630551 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.630721 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.630876 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.631046 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.631188 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.631355 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.631495 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.631661 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.631831 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.632000 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.632133 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.632313 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.632475 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.632621 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.632789 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.632926 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.633113 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.633236 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.633446 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.633544 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.633777 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.633895 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.634091 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.634194 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.634426 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.634523 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.634729 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.634822 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.635051 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.635146 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.635361 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.635456 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.635667 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.635759 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.635999 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.636114 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.636302 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.636403 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.636619 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.636746 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.636929 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.637052 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.637241 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.637347 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.637618 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.637728 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.637859 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.637979 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.638164 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.638297 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.638473 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.638604 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.638780 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.638929 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.639104 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.639249 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.639412 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.639565 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.639738 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.639915 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.640073 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.640236 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.640416 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.640555 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.640692 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.640874 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.640999 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.641193 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.641343 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.641506 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.641652 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.641823 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.641987 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.642146 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.642307 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.642544 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.643287 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.643589 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.643694 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.643947 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.644058 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.644267 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.644371 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.644582 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.644677 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.644897 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.644999 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.645212 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.645356 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.645529 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.645651 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.645843 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.645978 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.646154 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.646257 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.646466 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.646887 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.647040 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.647151 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.647371 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.647466 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.647697 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.647875 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.648045 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.648155 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.648387 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.648577 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.648716 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.648917 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.649012 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.649240 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.649335 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.649558 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.649653 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.649877 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.649981 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.650197 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.650294 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.650515 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.650621 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.650832 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.650936 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.651147 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.651248 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.651467 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.651605 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.651804 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.651932 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.652118 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.652224 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.652433 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.652543 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.652747 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.652851 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.653061 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.653154 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.653372 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.653466 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.653688 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.653802 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.654002 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.654117 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.654324 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.654420 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.654660 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.654755 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.654980 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.655075 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.655295 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.655398 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.655607 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.655705 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.655951 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.656137 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.656298 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.656521 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.656674 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.656828 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.656920 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.657097 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.657243 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.657422 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.657569 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.657739 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.657887 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.658039 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.658200 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.658389 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.658542 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.658715 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.658860 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.659023 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.659172 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.659316 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.659457 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.659623 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.659768 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.659957 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.660068 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.660262 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.660357 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.660583 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.660686 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.660894 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.661124 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.661220 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.661442 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.661545 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.661778 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.661882 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.662107 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.662334 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.662437 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.662685 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.662788 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.663001 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.663096 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.663327 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.663431 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.663650 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.663744 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.663988 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.664091 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.664294 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.664437 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.664605 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.664710 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.664909 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.665011 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.665215 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.665316 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.665529 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.665633 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.665838 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.665939 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.666145 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.666269 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.666451 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.666572 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.666759 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.667001 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.667110 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.667339 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.667443 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.667653 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.667749 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.667985 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.668097 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.668310 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.668424 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.668616 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.668720 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.668932 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.669032 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.669226 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.669338 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.669534 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.669628 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.669839 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.669932 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.670139 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.670245 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.670444 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.670537 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.670748 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.670863 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.671053 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.671155 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.671354 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.671446 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.671663 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.671769 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.671990 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.672087 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.672302 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.672396 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.672603 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.672704 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.672911 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.673006 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.673225 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.673325 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.673534 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.673642 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.673870 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.674066 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.674221 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.674364 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.674534 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.674686 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.674843 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.674987 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.675137 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.675280 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.675428 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.675580 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.675724 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.675898 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.676064 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.676172 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.676397 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.676509 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.676675 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.676906 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.677017 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.677244 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.677362 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.677562 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.677658 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.677897 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.678003 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.678235 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.678351 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.678541 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.678644 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.678846 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.678958 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.679152 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.679271 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.679462 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.679571 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.679774 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.679895 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.680106 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.680223 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.680414 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.680517 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.680723 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.680833 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.681034 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.681151 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.681340 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.681594 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.681687 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.681939 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.682046 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.682250 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.682354 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.682560 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.682661 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.682867 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.682974 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.683175 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.683270 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.683483 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.683590 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.683883 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.684002 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.684157 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.684250 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.684474 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.684591 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.684789 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.684909 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.685101 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.685195 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.685413 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.685505 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.685728 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.685824 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.686037 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.686139 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.686349 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.686459 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.686660 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.686770 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.686970 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.687070 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.687282 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.687376 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.687593 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.687688 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.687917 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.688014 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.688235 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.688344 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.688555 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.688664 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.688896 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.688989 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.689219 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.689871 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.690091 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.690195 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.690500 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.690615 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.690819 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.690923 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.691132 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.691226 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.691446 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.691540 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.691756 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.691883 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.692094 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.692194 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.692415 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.692508 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.692747 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.692843 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.693066 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.693160 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.693371 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.693462 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.693678 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.693781 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.693985 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.694079 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.694294 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.694398 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.694612 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.694709 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.694923 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.695038 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.695224 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.695328 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.695528 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.695646 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.695860 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.695971 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.696167 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.696302 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.696536 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.696664 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.696769 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.696940 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.697066 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.697284 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.697379 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.697619 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.697722 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.697939 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.698047 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.698242 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.698379 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.698546 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.698641 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.698852 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.698960 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.699153 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.699254 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.699463 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.699598 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.699774 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.699905 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.700106 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.700208 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.700414 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.700508 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.700717 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.700819 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.701021 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.701114 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.701324 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.701426 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.701630 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.701732 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.701936 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.702030 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.702247 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.702341 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.702553 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.702656 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.702860 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.702961 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.703165 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.703258 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.703471 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.703573 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.703810 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.703907 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.704110 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.704227 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.704418 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.704519 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.704723 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.704818 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.705612 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.705732 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.705925 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.706019 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.706230 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.706405 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.706541 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.706726 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.706856 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.707038 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.707194 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.707347 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.707512 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.707659 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.707862 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.708011 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.708176 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.708322 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.708496 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.708647 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.708793 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.708918 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.709112 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.709241 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.709437 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.709556 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.709754 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.709868 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.710067 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.710197 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.710401 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.710503 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.710714 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.710807 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.711029 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.711152 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.711344 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.711475 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.711657 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.711837 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.711996 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.712128 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.712308 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.712446 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.712635 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.712772 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.712964 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.713104 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.713274 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.713415 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.713602 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.713742 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.713925 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.714067 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.714248 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.714414 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.714566 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.714730 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.714879 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.715091 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.715232 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.715400 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.715494 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.715717 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.715920 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.716059 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.716177 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.716362 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.716506 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.716768 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.716960 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=129350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 06 10:37:17.717118 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.717393 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.717723 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.718051 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.718365 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.718694 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.719024 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.719373 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.719692 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.720066 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.720397 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.720743 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.721061 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.721370 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 10:37:17.721615 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=129349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 06 10:37:17.777242 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO dbcounter [None req-36377bc1-709f-4f53-91e8-1487c6d80cfa None None] Registered counter for database nova_api Jun 06 10:37:17.782499 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO dbcounter [None req-018c8877-fd86-40f4-8cd7-a0cfc4fdcdc9 None None] Registered counter for database nova_api Jun 06 10:37:17.797790 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_db.sqlalchemy.engines [None req-36377bc1-709f-4f53-91e8-1487c6d80cfa None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129350) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 06 10:37:17.803356 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_db.sqlalchemy.engines [None req-018c8877-fd86-40f4-8cd7-a0cfc4fdcdc9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129349) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 06 10:37:17.806755 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG dbcounter [-] [129350] Writer thread running {{(pid=129350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 06 10:37:17.809818 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG dbcounter [-] [129349] Writer thread running {{(pid=129349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 06 10:37:17.865619 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.context [None req-36377bc1-709f-4f53-91e8-1487c6d80cfa None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),b2cac780-caea-4a39-b7a4-6bc4960cc6e0(cell1) {{(pid=129350) load_cells /opt/stack/nova/nova/context.py:464}} Jun 06 10:37:17.867700 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.context [None req-018c8877-fd86-40f4-8cd7-a0cfc4fdcdc9 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),b2cac780-caea-4a39-b7a4-6bc4960cc6e0(cell1) {{(pid=129349) load_cells /opt/stack/nova/nova/context.py:464}} Jun 06 10:37:17.869753 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-36377bc1-709f-4f53-91e8-1487c6d80cfa None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:37:17.871319 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-36377bc1-709f-4f53-91e8-1487c6d80cfa None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:37:17.872132 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-018c8877-fd86-40f4-8cd7-a0cfc4fdcdc9 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:37:17.872270 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-36377bc1-709f-4f53-91e8-1487c6d80cfa None None] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:37:17.873727 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-018c8877-fd86-40f4-8cd7-a0cfc4fdcdc9 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:37:17.874076 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-36377bc1-709f-4f53-91e8-1487c6d80cfa None None] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:37:17.874542 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-018c8877-fd86-40f4-8cd7-a0cfc4fdcdc9 None None] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:37:17.876114 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO dbcounter [None req-36377bc1-709f-4f53-91e8-1487c6d80cfa None None] Registered counter for database nova_cell0 Jun 06 10:37:17.876645 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-018c8877-fd86-40f4-8cd7-a0cfc4fdcdc9 None None] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:37:17.878757 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO dbcounter [None req-018c8877-fd86-40f4-8cd7-a0cfc4fdcdc9 None None] Registered counter for database nova_cell0 Jun 06 10:37:17.882060 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO dbcounter [None req-36377bc1-709f-4f53-91e8-1487c6d80cfa None None] Registered counter for database nova_cell1 Jun 06 10:37:17.884176 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO dbcounter [None req-018c8877-fd86-40f4-8cd7-a0cfc4fdcdc9 None None] Registered counter for database nova_cell1 Jun 06 10:37:17.889510 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_db.sqlalchemy.engines [None req-36377bc1-709f-4f53-91e8-1487c6d80cfa None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129350) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 06 10:37:17.891996 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_db.sqlalchemy.engines [None req-018c8877-fd86-40f4-8cd7-a0cfc4fdcdc9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129349) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 06 10:37:17.893515 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_db.sqlalchemy.engines [None req-018c8877-fd86-40f4-8cd7-a0cfc4fdcdc9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129349) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 06 10:37:17.898204 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_db.sqlalchemy.engines [None req-36377bc1-709f-4f53-91e8-1487c6d80cfa None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129350) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 06 10:37:17.898746 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG dbcounter [-] [129349] Writer thread running {{(pid=129349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 06 10:37:17.903308 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG dbcounter [-] [129350] Writer thread running {{(pid=129350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 06 10:37:17.904627 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG dbcounter [-] [129350] Writer thread running {{(pid=129350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 06 10:37:18.045333 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG dbcounter [-] [129349] Writer thread running {{(pid=129349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 06 10:37:18.054975 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO dbcounter [None req-018c8877-fd86-40f4-8cd7-a0cfc4fdcdc9 None None] Registered counter for database nova_cell0 Jun 06 10:37:18.060259 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO dbcounter [None req-36377bc1-709f-4f53-91e8-1487c6d80cfa None None] Registered counter for database nova_cell0 Jun 06 10:37:18.061772 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_db.sqlalchemy.engines [None req-018c8877-fd86-40f4-8cd7-a0cfc4fdcdc9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129349) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 06 10:37:18.066622 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG dbcounter [-] [129349] Writer thread running {{(pid=129349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 06 10:37:18.067390 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_db.sqlalchemy.engines [None req-36377bc1-709f-4f53-91e8-1487c6d80cfa None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129350) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 06 10:37:18.072491 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG dbcounter [-] [129350] Writer thread running {{(pid=129350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 06 10:37:18.507387 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: WARNING keystonemiddleware.auth_token [None req-018c8877-fd86-40f4-8cd7-a0cfc4fdcdc9 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 06 10:37:18.514807 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: WARNING keystonemiddleware.auth_token [None req-018c8877-fd86-40f4-8cd7-a0cfc4fdcdc9 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 06 10:37:18.522077 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: WARNING keystonemiddleware.auth_token [None req-36377bc1-709f-4f53-91e8-1487c6d80cfa None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 06 10:37:18.529664 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: WARNING keystonemiddleware.auth_token [None req-36377bc1-709f-4f53-91e8-1487c6d80cfa None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 06 10:37:18.740898 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: WARNING keystonemiddleware.auth_token [None req-018c8877-fd86-40f4-8cd7-a0cfc4fdcdc9 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 06 10:37:18.746937 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: WARNING keystonemiddleware.auth_token [None req-018c8877-fd86-40f4-8cd7-a0cfc4fdcdc9 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 06 10:37:18.752816 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5650c9cf79c0 pid: 129349 (default app) Jun 06 10:37:18.757523 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: WARNING keystonemiddleware.auth_token [None req-36377bc1-709f-4f53-91e8-1487c6d80cfa None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 06 10:37:18.763516 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: WARNING keystonemiddleware.auth_token [None req-36377bc1-709f-4f53-91e8-1487c6d80cfa None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 06 10:37:18.769018 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5650c9cf79c0 pid: 129350 (default app) Jun 06 10:38:01.320366 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG dbcounter [-] [129349] Writing DB stats nova_api:SELECT=3 {{(pid=129349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 10:38:01.321206 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG dbcounter [-] [129349] Writing DB stats nova_cell0:SELECT=3 {{(pid=129349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 10:38:01.321923 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG dbcounter [-] [129349] Writing DB stats nova_cell1:SELECT=3 {{(pid=129349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 10:38:01.322643 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG dbcounter [-] [129349] Writing DB stats nova_cell0:SELECT=3 {{(pid=129349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 10:38:02.919900 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-c4e1f512-8f4c-4e00-9842-5f0b94b342d0 tempest-VolumesSnapshotsTestJSON-1753425842 tempest-VolumesSnapshotsTestJSON-1753425842-project] Action: 'create', calling method: .version_select at 0x7f8fd98ff5e0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-497720746"}} {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 10:38:03.496651 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG dbcounter [-] [129350] Writing DB stats nova_api:SELECT=3 {{(pid=129350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 10:38:03.498965 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG dbcounter [-] [129350] Writing DB stats nova_cell1:SELECT=3 {{(pid=129350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 10:38:03.504203 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG dbcounter [-] [129350] Writing DB stats nova_cell0:SELECT=3 {{(pid=129350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 10:38:03.506804 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG dbcounter [-] [129350] Writing DB stats nova_cell0:SELECT=3 {{(pid=129350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 10:38:04.451069 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-a89f1d6f-0cb2-4a29-b922-a907dc8d47d5 tempest-DeleteServersTestJSON-1512496307 tempest-DeleteServersTestJSON-1512496307-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1555154854", "imageRef": "6eea2d98-354d-4083-b74c-abcbb97f9e1a", "flavorRef": "452", "networks": [{"uuid": "27539e52-e334-4eba-bb9e-d19467fe9335"}]}} {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 10:38:04.820454 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-c4e1f512-8f4c-4e00-9842-5f0b94b342d0 tempest-VolumesSnapshotsTestJSON-1753425842 tempest-VolumesSnapshotsTestJSON-1753425842-project] 10.222.0.42 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 3.505131 Jun 06 10:38:04.822017 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 1/1] 10.222.0.42 () {60 vars in 1154 bytes} [Mon Jun 6 10:38:01 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 3509 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jun 06 10:38:04.835163 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-7db330e1-43bf-4bf3-97ee-cd53317dcb1d tempest-VolumesSnapshotsTestJSON-1753425842 tempest-VolumesSnapshotsTestJSON-1753425842-project] Calling method '.version_select at 0x7f8fd97ca5e0>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:38:04.970154 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-7db330e1-43bf-4bf3-97ee-cd53317dcb1d tempest-VolumesSnapshotsTestJSON-1753425842 tempest-VolumesSnapshotsTestJSON-1753425842-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/bc9b8813-c596-4f95-ad2e-f81be73f75b9" status: 200 len: 344 microversion: 2.1 time: 0.139610 Jun 06 10:38:04.970724 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 2/2] 10.222.0.42 () {58 vars in 1244 bytes} [Mon Jun 6 10:38:04 2022] GET /compute/v2.1/os-volumes/bc9b8813-c596-4f95-ad2e-f81be73f75b9 => generated 344 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 10:38:05.165748 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.network.neutron [None req-a89f1d6f-0cb2-4a29-b922-a907dc8d47d5 tempest-DeleteServersTestJSON-1512496307 tempest-DeleteServersTestJSON-1512496307-project] validate_networks() for [('27539e52-e334-4eba-bb9e-d19467fe9335', None, None, None, None, None)] {{(pid=129350) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 06 10:38:05.985933 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-6e3ab9ff-67ca-4e69-b519-0ccf91594102 tempest-VolumesSnapshotsTestJSON-1753425842 tempest-VolumesSnapshotsTestJSON-1753425842-project] Calling method '.version_select at 0x7f8fd97ca940>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:38:06.090000 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-6e3ab9ff-67ca-4e69-b519-0ccf91594102 tempest-VolumesSnapshotsTestJSON-1753425842 tempest-VolumesSnapshotsTestJSON-1753425842-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/bc9b8813-c596-4f95-ad2e-f81be73f75b9" status: 200 len: 345 microversion: 2.1 time: 0.109373 Jun 06 10:38:06.090579 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 3/3] 10.222.0.42 () {58 vars in 1244 bytes} [Mon Jun 6 10:38:05 2022] GET /compute/v2.1/os-volumes/bc9b8813-c596-4f95-ad2e-f81be73f75b9 => generated 345 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 10:38:06.102725 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-05c9c90e-bd80-46cb-9867-e7f66ec87638 tempest-VolumesSnapshotsTestJSON-1753425842 tempest-VolumesSnapshotsTestJSON-1753425842-project] Action: 'create', calling method: .version_select at 0x7f8fd97caca0>, body: {"snapshot": {"volume_id": "bc9b8813-c596-4f95-ad2e-f81be73f75b9", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-173281668"}} {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 10:38:06.518745 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-05c9c90e-bd80-46cb-9867-e7f66ec87638 tempest-VolumesSnapshotsTestJSON-1753425842 tempest-VolumesSnapshotsTestJSON-1753425842-project] 10.222.0.42 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.420175 Jun 06 10:38:06.520069 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 4/4] 10.222.0.42 () {60 vars in 1161 bytes} [Mon Jun 6 10:38:06 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 10:38:06.535547 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-8fc96213-2843-400c-9b63-a2fa36fbd70c tempest-VolumesSnapshotsTestJSON-1753425842 tempest-VolumesSnapshotsTestJSON-1753425842-project] Calling method '.version_select at 0x7f8fd97d8940>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:38:06.686746 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-8fc96213-2843-400c-9b63-a2fa36fbd70c tempest-VolumesSnapshotsTestJSON-1753425842 tempest-VolumesSnapshotsTestJSON-1753425842-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/91af1f5f-63d9-4589-b407-1089399f2d40" status: 200 len: 286 microversion: 2.1 time: 0.160564 Jun 06 10:38:06.688151 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 5/5] 10.222.0.42 () {58 vars in 1250 bytes} [Mon Jun 6 10:38:06 2022] GET /compute/v2.1/os-snapshots/91af1f5f-63d9-4589-b407-1089399f2d40 => generated 286 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 06 10:38:06.700707 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-a39c557e-4246-490b-ad2c-a702885bad97 tempest-VolumesSnapshotsTestJSON-1753425842 tempest-VolumesSnapshotsTestJSON-1753425842-project] Calling method '.version_select at 0x7f8fd97cae50>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:38:06.815868 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-a39c557e-4246-490b-ad2c-a702885bad97 tempest-VolumesSnapshotsTestJSON-1753425842 tempest-VolumesSnapshotsTestJSON-1753425842-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.121248 Jun 06 10:38:06.817121 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 6/6] 10.222.0.42 () {58 vars in 1139 bytes} [Mon Jun 6 10:38:06 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 10:38:06.827916 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-92209fe4-5352-4b48-9602-e6e19e9e5b6d tempest-VolumesSnapshotsTestJSON-1753425842 tempest-VolumesSnapshotsTestJSON-1753425842-project] Calling method '.version_select at 0x7f8fd97d89d0>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:38:06.897286 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-92209fe4-5352-4b48-9602-e6e19e9e5b6d tempest-VolumesSnapshotsTestJSON-1753425842 tempest-VolumesSnapshotsTestJSON-1753425842-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/91af1f5f-63d9-4589-b407-1089399f2d40" status: 200 len: 286 microversion: 2.1 time: 0.073760 Jun 06 10:38:06.897851 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 7/7] 10.222.0.42 () {58 vars in 1250 bytes} [Mon Jun 6 10:38:06 2022] GET /compute/v2.1/os-snapshots/91af1f5f-63d9-4589-b407-1089399f2d40 => generated 286 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 10:38:07.451430 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.virt.hardware [None req-a89f1d6f-0cb2-4a29-b922-a907dc8d47d5 tempest-DeleteServersTestJSON-1512496307 tempest-DeleteServersTestJSON-1512496307-project] Flavor limits 0:0:0 {{(pid=129350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 06 10:38:07.452396 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.virt.hardware [None req-a89f1d6f-0cb2-4a29-b922-a907dc8d47d5 tempest-DeleteServersTestJSON-1512496307 tempest-DeleteServersTestJSON-1512496307-project] Image limits 0:0:0 {{(pid=129350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 06 10:38:07.453564 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.virt.hardware [None req-a89f1d6f-0cb2-4a29-b922-a907dc8d47d5 tempest-DeleteServersTestJSON-1512496307 tempest-DeleteServersTestJSON-1512496307-project] Flavor pref 0:0:0 {{(pid=129350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 06 10:38:07.455962 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.virt.hardware [None req-a89f1d6f-0cb2-4a29-b922-a907dc8d47d5 tempest-DeleteServersTestJSON-1512496307 tempest-DeleteServersTestJSON-1512496307-project] Image pref 0:0:0 {{(pid=129350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 06 10:38:07.456572 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.virt.hardware [None req-a89f1d6f-0cb2-4a29-b922-a907dc8d47d5 tempest-DeleteServersTestJSON-1512496307 tempest-DeleteServersTestJSON-1512496307-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 06 10:38:07.482743 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-a89f1d6f-0cb2-4a29-b922-a907dc8d47d5 tempest-DeleteServersTestJSON-1512496307 tempest-DeleteServersTestJSON-1512496307-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:38:07.484737 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-a89f1d6f-0cb2-4a29-b922-a907dc8d47d5 tempest-DeleteServersTestJSON-1512496307 tempest-DeleteServersTestJSON-1512496307-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:38:07.485855 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-a89f1d6f-0cb2-4a29-b922-a907dc8d47d5 tempest-DeleteServersTestJSON-1512496307 tempest-DeleteServersTestJSON-1512496307-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:38:07.487526 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-a89f1d6f-0cb2-4a29-b922-a907dc8d47d5 tempest-DeleteServersTestJSON-1512496307 tempest-DeleteServersTestJSON-1512496307-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:38:07.596381 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.quota [None req-a89f1d6f-0cb2-4a29-b922-a907dc8d47d5 tempest-DeleteServersTestJSON-1512496307 tempest-DeleteServersTestJSON-1512496307-project] Getting quotas for project 8486d765afed40dc8795c7ba485d9535. Resources: {'ram', 'cores', 'instances'} {{(pid=129350) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 06 10:38:07.628074 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.quota [None req-a89f1d6f-0cb2-4a29-b922-a907dc8d47d5 tempest-DeleteServersTestJSON-1512496307 tempest-DeleteServersTestJSON-1512496307-project] Getting quotas for user 3bbc3cd193444a65861f6e6705fd32cf and project 8486d765afed40dc8795c7ba485d9535. Resources: {'ram', 'cores', 'instances'} {{(pid=129350) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 06 10:38:07.658344 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-a89f1d6f-0cb2-4a29-b922-a907dc8d47d5 tempest-DeleteServersTestJSON-1512496307 tempest-DeleteServersTestJSON-1512496307-project] Going to run 1 instances... {{(pid=129350) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 06 10:38:07.661543 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-a89f1d6f-0cb2-4a29-b922-a907dc8d47d5 tempest-DeleteServersTestJSON-1512496307 tempest-DeleteServersTestJSON-1512496307-project] [instance: d0c59b89-6051-4967-81c6-1e9559a7d7b6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6eea2d98-354d-4083-b74c-abcbb97f9e1a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129350) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 06 10:38:07.872515 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-a89f1d6f-0cb2-4a29-b922-a907dc8d47d5 tempest-DeleteServersTestJSON-1512496307 tempest-DeleteServersTestJSON-1512496307-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.398003 Jun 06 10:38:07.883814 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 1/8] 10.222.0.42 () {60 vars in 1146 bytes} [Mon Jun 6 10:38:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 4408 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 06 10:38:07.885252 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-bf45662c-8569-439f-bfed-8a334fb67f71 tempest-DeleteServersTestJSON-1512496307 tempest-DeleteServersTestJSON-1512496307-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:38:07.886689 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-bf45662c-8569-439f-bfed-8a334fb67f71 tempest-DeleteServersTestJSON-1512496307 tempest-DeleteServersTestJSON-1512496307-project] [instance: d0c59b89-6051-4967-81c6-1e9559a7d7b6] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:38:07.910380 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-818f43ba-92d4-4222-90c9-2bd2c038ff6d tempest-VolumesSnapshotsTestJSON-1753425842 tempest-VolumesSnapshotsTestJSON-1753425842-project] Calling method '.version_select at 0x7f8fd8f005e0>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:38:08.044033 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-818f43ba-92d4-4222-90c9-2bd2c038ff6d tempest-VolumesSnapshotsTestJSON-1753425842 tempest-VolumesSnapshotsTestJSON-1753425842-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/91af1f5f-63d9-4589-b407-1089399f2d40" status: 200 len: 286 microversion: 2.1 time: 0.137944 Jun 06 10:38:08.044606 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 2/9] 10.222.0.42 () {58 vars in 1250 bytes} [Mon Jun 6 10:38:07 2022] GET /compute/v2.1/os-snapshots/91af1f5f-63d9-4589-b407-1089399f2d40 => generated 286 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 06 10:38:08.152987 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-bf45662c-8569-439f-bfed-8a334fb67f71 tempest-DeleteServersTestJSON-1512496307 tempest-DeleteServersTestJSON-1512496307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bbc3cd193444a65861f6e6705fd32cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8486d765afed40dc8795c7ba485d9535', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:38:08.185587 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-bf45662c-8569-439f-bfed-8a334fb67f71 tempest-DeleteServersTestJSON-1512496307 tempest-DeleteServersTestJSON-1512496307-project] 10.222.0.42 "GET /compute/v2.1/servers/d0c59b89-6051-4967-81c6-1e9559a7d7b6" status: 200 len: 1215 microversion: 2.1 time: 0.304880 Jun 06 10:38:08.186375 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 8/10] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:38:07 2022] GET /compute/v2.1/servers/d0c59b89-6051-4967-81c6-1e9559a7d7b6 => generated 1215 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 10:38:09.055913 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-51e4229d-f1c8-4685-aab7-c06e579d73c3 tempest-VolumesSnapshotsTestJSON-1753425842 tempest-VolumesSnapshotsTestJSON-1753425842-project] Calling method '.version_select at 0x7f8fd86ed1f0>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:38:09.157961 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-51e4229d-f1c8-4685-aab7-c06e579d73c3 tempest-VolumesSnapshotsTestJSON-1753425842 tempest-VolumesSnapshotsTestJSON-1753425842-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/91af1f5f-63d9-4589-b407-1089399f2d40" status: 200 len: 286 microversion: 2.1 time: 0.105813 Jun 06 10:38:09.159047 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 3/11] 10.222.0.42 () {58 vars in 1250 bytes} [Mon Jun 6 10:38:09 2022] GET /compute/v2.1/os-snapshots/91af1f5f-63d9-4589-b407-1089399f2d40 => generated 286 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 10:38:09.220429 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-4c7cf51e-e122-4577-8a59-dae904dd29a8 tempest-DeleteServersTestJSON-1512496307 tempest-DeleteServersTestJSON-1512496307-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:38:09.221890 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-4c7cf51e-e122-4577-8a59-dae904dd29a8 tempest-DeleteServersTestJSON-1512496307 tempest-DeleteServersTestJSON-1512496307-project] [instance: d0c59b89-6051-4967-81c6-1e9559a7d7b6] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:38:09.420080 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-4c7cf51e-e122-4577-8a59-dae904dd29a8 tempest-DeleteServersTestJSON-1512496307 tempest-DeleteServersTestJSON-1512496307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bbc3cd193444a65861f6e6705fd32cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8486d765afed40dc8795c7ba485d9535', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:38:09.431705 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-4c7cf51e-e122-4577-8a59-dae904dd29a8 tempest-DeleteServersTestJSON-1512496307 tempest-DeleteServersTestJSON-1512496307-project] 10.222.0.42 "GET /compute/v2.1/servers/d0c59b89-6051-4967-81c6-1e9559a7d7b6" status: 200 len: 1215 microversion: 2.1 time: 0.233025 Jun 06 10:38:09.440168 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 9/12] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:38:09 2022] GET /compute/v2.1/servers/d0c59b89-6051-4967-81c6-1e9559a7d7b6 => generated 1215 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:38:10.169342 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-43f5d402-71b2-464f-8c21-146278f631bf tempest-VolumesSnapshotsTestJSON-1753425842 tempest-VolumesSnapshotsTestJSON-1753425842-project] Calling method '.version_select at 0x7f8fd86ed8b0>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:38:10.247060 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-43f5d402-71b2-464f-8c21-146278f631bf tempest-VolumesSnapshotsTestJSON-1753425842 tempest-VolumesSnapshotsTestJSON-1753425842-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/91af1f5f-63d9-4589-b407-1089399f2d40" status: 200 len: 287 microversion: 2.1 time: 0.081631 Jun 06 10:38:10.247818 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 4/13] 10.222.0.42 () {58 vars in 1250 bytes} [Mon Jun 6 10:38:10 2022] GET /compute/v2.1/os-snapshots/91af1f5f-63d9-4589-b407-1089399f2d40 => generated 287 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 06 10:38:10.274042 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-7d4ba8cd-3913-4c4e-866f-72ba419564d0 tempest-VolumesSnapshotsTestJSON-1753425842 tempest-VolumesSnapshotsTestJSON-1753425842-project] Calling method '.version_select at 0x7f8fd97cae50>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:38:10.456891 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-7d4ba8cd-3913-4c4e-866f-72ba419564d0 tempest-VolumesSnapshotsTestJSON-1753425842 tempest-VolumesSnapshotsTestJSON-1753425842-project] 10.222.0.42 "DELETE /compute/v2.1/os-snapshots/91af1f5f-63d9-4589-b407-1089399f2d40" status: 202 len: 0 microversion: 2.1 time: 0.200566 Jun 06 10:38:10.460188 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 10/14] 10.222.0.42 () {58 vars in 1253 bytes} [Mon Jun 6 10:38:10 2022] DELETE /compute/v2.1/os-snapshots/91af1f5f-63d9-4589-b407-1089399f2d40 => generated 0 bytes in 205 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 06 10:38:10.461663 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-2e28e36f-1562-49c0-a497-4dadc3c39664 tempest-DeleteServersTestJSON-1512496307 tempest-DeleteServersTestJSON-1512496307-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:38:10.462362 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-2e28e36f-1562-49c0-a497-4dadc3c39664 tempest-DeleteServersTestJSON-1512496307 tempest-DeleteServersTestJSON-1512496307-project] [instance: d0c59b89-6051-4967-81c6-1e9559a7d7b6] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:38:10.468193 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-c7a6a73f-6692-4142-8cc2-24d3c8c919e2 tempest-VolumesSnapshotsTestJSON-1753425842 tempest-VolumesSnapshotsTestJSON-1753425842-project] Calling method '.version_select at 0x7f8fd97aeaf0>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:38:10.511752 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-c7a6a73f-6692-4142-8cc2-24d3c8c919e2 tempest-VolumesSnapshotsTestJSON-1753425842 tempest-VolumesSnapshotsTestJSON-1753425842-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/91af1f5f-63d9-4589-b407-1089399f2d40" status: 200 len: 286 microversion: 2.1 time: 0.047232 Jun 06 10:38:10.514752 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-2e28e36f-1562-49c0-a497-4dadc3c39664 tempest-DeleteServersTestJSON-1512496307 tempest-DeleteServersTestJSON-1512496307-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:38:10.515492 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-2e28e36f-1562-49c0-a497-4dadc3c39664 tempest-DeleteServersTestJSON-1512496307 tempest-DeleteServersTestJSON-1512496307-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:38:10.515773 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 11/15] 10.222.0.42 () {58 vars in 1250 bytes} [Mon Jun 6 10:38:10 2022] GET /compute/v2.1/os-snapshots/91af1f5f-63d9-4589-b407-1089399f2d40 => generated 286 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 10:38:10.524732 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-2e28e36f-1562-49c0-a497-4dadc3c39664 tempest-DeleteServersTestJSON-1512496307 tempest-DeleteServersTestJSON-1512496307-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:38:10.525429 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-2e28e36f-1562-49c0-a497-4dadc3c39664 tempest-DeleteServersTestJSON-1512496307 tempest-DeleteServersTestJSON-1512496307-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:38:11.027063 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-2e28e36f-1562-49c0-a497-4dadc3c39664 tempest-DeleteServersTestJSON-1512496307 tempest-DeleteServersTestJSON-1512496307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bbc3cd193444a65861f6e6705fd32cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8486d765afed40dc8795c7ba485d9535', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:38:11.056801 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-2e28e36f-1562-49c0-a497-4dadc3c39664 tempest-DeleteServersTestJSON-1512496307 tempest-DeleteServersTestJSON-1512496307-project] 10.222.0.42 "GET /compute/v2.1/servers/d0c59b89-6051-4967-81c6-1e9559a7d7b6" status: 200 len: 1211 microversion: 2.1 time: 0.602283 Jun 06 10:38:11.060303 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 5/16] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:38:10 2022] GET /compute/v2.1/servers/d0c59b89-6051-4967-81c6-1e9559a7d7b6 => generated 1211 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:38:11.530034 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-56cd2104-1909-4ae4-99ca-e527977059de tempest-VolumesSnapshotsTestJSON-1753425842 tempest-VolumesSnapshotsTestJSON-1753425842-project] Calling method '.version_select at 0x7f8fd97ae280>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:38:11.576061 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.wsgi [None req-56cd2104-1909-4ae4-99ca-e527977059de tempest-VolumesSnapshotsTestJSON-1753425842 tempest-VolumesSnapshotsTestJSON-1753425842-project] HTTP exception thrown: Snapshot 91af1f5f-63d9-4589-b407-1089399f2d40 could not be found. Jun 06 10:38:11.580532 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-56cd2104-1909-4ae4-99ca-e527977059de tempest-VolumesSnapshotsTestJSON-1753425842 tempest-VolumesSnapshotsTestJSON-1753425842-project] Request method failure captured: Jun 06 10:38:11.580532 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: request: GET /compute/v2.1/os-snapshots/91af1f5f-63d9-4589-b407-1089399f2d40 HTTP/1.1 Jun 06 10:38:11.580532 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: Accept: application/json Jun 06 10:38:11.580532 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: Accept-Encoding: identity Jun 06 10:38:11.580532 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: Connection: close Jun 06 10:38:11.580532 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: Content-Length: 0 Jun 06 10:38:11.580532 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: Content-Type: application/json Jun 06 10:38:11.580532 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: Host: 10.222.0.42 Jun 06 10:38:11.580532 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: Openstack-System-Scope: None Jun 06 10:38:11.580532 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: User-Agent: python-urllib3/1.26.9 Jun 06 10:38:11.580532 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Auth-Token: gAAAAABindkJC-moogO8ZNAffqsathgiag4nPXobelO6QUFLJhgi-TNuuwhGGhGnBRvN1swux2zLZjptm3wiJEz7vuY9Rd5Ji2KL8Cefd_HV8f6uF5FAYcwASHwa670PXHmFGg_SnTPwl0nCxKtFjdecrZtdcjIlb14GP1L71lCABkQywzTBY5o Jun 06 10:38:11.580532 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Domain-Id: None Jun 06 10:38:11.580532 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Domain-Name: None Jun 06 10:38:11.580532 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Identity-Status: Confirmed Jun 06 10:38:11.580532 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Is-Admin-Project: True Jun 06 10:38:11.580532 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Project-Domain-Id: default Jun 06 10:38:11.580532 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Project-Domain-Name: Default Jun 06 10:38:11.580532 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Project-Id: 3428f9ec1f0444e189b0d2c465f59419 Jun 06 10:38:11.580532 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1753425842 Jun 06 10:38:11.580532 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Role: member,reader Jun 06 10:38:11.580532 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Roles: member,reader Jun 06 10:38:11.581775 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/3428f9ec1f0444e189b0d2c465f59419"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/3428f9ec1f0444e189b0d2c465f59419"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/3428f9ec1f0444e189b0d2c465f59419"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_3428f9ec1f0444e189b0d2c465f59419", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Jun 06 10:38:11.581775 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1753425842 Jun 06 10:38:11.581775 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Tenant-Id: 3428f9ec1f0444e189b0d2c465f59419 Jun 06 10:38:11.581775 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1753425842 Jun 06 10:38:11.581775 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-User: tempest-VolumesSnapshotsTestJSON-1753425842-project Jun 06 10:38:11.581775 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-User-Domain-Id: default Jun 06 10:38:11.581775 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-User-Domain-Name: Default Jun 06 10:38:11.581775 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-User-Id: 749aa2ca183140e2a86d6be9aac6b4a4 Jun 06 10:38:11.581775 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1753425842-project Jun 06 10:38:11.581775 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: method: Jun 06 10:38:11.581775 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: exception: Snapshot 91af1f5f-63d9-4589-b407-1089399f2d40 could not be found. Jun 06 10:38:11.581775 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: action_args: {'id': '91af1f5f-63d9-4589-b407-1089399f2d40'} Jun 06 10:38:11.581775 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 10:38:11.582425 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 10:38:11.582425 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 06 10:38:11.582425 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 06 10:38:11.582425 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 06 10:38:11.582425 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 06 10:38:11.582425 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 06 10:38:11.582425 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 06 10:38:11.582425 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 06 10:38:11.582425 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 06 10:38:11.582425 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 06 10:38:11.582425 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 06 10:38:11.582425 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 06 10:38:11.582425 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 06 10:38:11.582425 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 06 10:38:11.582425 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 06 10:38:11.582425 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 91af1f5f-63d9-4589-b407-1089399f2d40 could not be found. (HTTP 404) (Request-ID: req-f27da0cf-2b29-4b3e-83a3-4607a4ef0e84) Jun 06 10:38:11.582425 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Jun 06 10:38:11.582425 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 10:38:11.583306 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Jun 06 10:38:11.583306 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 10:38:11.583306 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jun 06 10:38:11.583306 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jun 06 10:38:11.583306 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 06 10:38:11.583306 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 06 10:38:11.583306 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jun 06 10:38:11.583306 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jun 06 10:38:11.583306 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 06 10:38:11.583306 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 06 10:38:11.583306 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 06 10:38:11.583306 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 06 10:38:11.583306 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 06 10:38:11.583306 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 06 10:38:11.583306 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 06 10:38:11.583306 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 06 10:38:11.583306 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 06 10:38:11.583306 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 06 10:38:11.583306 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 06 10:38:11.584324 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 06 10:38:11.584324 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 06 10:38:11.584324 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 06 10:38:11.584324 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 06 10:38:11.584324 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 06 10:38:11.584324 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 91af1f5f-63d9-4589-b407-1089399f2d40 could not be found. Jun 06 10:38:11.584324 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Jun 06 10:38:11.584324 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 10:38:11.584324 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Jun 06 10:38:11.584324 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 10:38:11.584324 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 10:38:11.584324 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 10:38:11.584324 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 10:38:11.584324 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 10:38:11.584324 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 06 10:38:11.584324 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 06 10:38:11.584324 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 10:38:11.584324 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 10:38:11.584324 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jun 06 10:38:11.584324 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 06 10:38:11.585286 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 91af1f5f-63d9-4589-b407-1089399f2d40 could not be found. Jun 06 10:38:11.585286 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Jun 06 10:38:11.585286 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 10:38:11.585286 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Jun 06 10:38:11.585286 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 10:38:11.585286 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 10:38:11.585286 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 10:38:11.585286 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 10:38:11.585286 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 10:38:11.585286 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 91af1f5f-63d9-4589-b407-1089399f2d40 could not be found. Jun 06 10:38:11.585286 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Jun 06 10:38:11.585286 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-56cd2104-1909-4ae4-99ca-e527977059de tempest-VolumesSnapshotsTestJSON-1753425842 tempest-VolumesSnapshotsTestJSON-1753425842-project] Returning 404 to user: Snapshot 91af1f5f-63d9-4589-b407-1089399f2d40 could not be found. {{(pid=129349) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 10:38:11.585286 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-56cd2104-1909-4ae4-99ca-e527977059de tempest-VolumesSnapshotsTestJSON-1753425842 tempest-VolumesSnapshotsTestJSON-1753425842-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/91af1f5f-63d9-4589-b407-1089399f2d40" status: 404 len: 111 microversion: 2.1 time: 0.056111 Jun 06 10:38:11.585910 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 12/17] 10.222.0.42 () {58 vars in 1250 bytes} [Mon Jun 6 10:38:11 2022] GET /compute/v2.1/os-snapshots/91af1f5f-63d9-4589-b407-1089399f2d40 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 06 10:38:11.600524 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-d3bf0e6c-cab0-4a1e-8d4f-368997ecfcbb tempest-VolumesSnapshotsTestJSON-1753425842 tempest-VolumesSnapshotsTestJSON-1753425842-project] Calling method '.version_select at 0x7f8fd8f00b80>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:38:11.751043 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-d3bf0e6c-cab0-4a1e-8d4f-368997ecfcbb tempest-VolumesSnapshotsTestJSON-1753425842 tempest-VolumesSnapshotsTestJSON-1753425842-project] 10.222.0.42 "DELETE /compute/v2.1/os-volumes/bc9b8813-c596-4f95-ad2e-f81be73f75b9" status: 202 len: 0 microversion: 2.1 time: 0.159920 Jun 06 10:38:11.755063 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 6/18] 10.222.0.42 () {58 vars in 1247 bytes} [Mon Jun 6 10:38:11 2022] DELETE /compute/v2.1/os-volumes/bc9b8813-c596-4f95-ad2e-f81be73f75b9 => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 06 10:38:11.760772 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-fc6e1bd0-acde-43ff-9bb9-022691826d63 tempest-VolumesSnapshotsTestJSON-1753425842 tempest-VolumesSnapshotsTestJSON-1753425842-project] Calling method '.version_select at 0x7f8fd97155e0>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:38:11.839250 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-fc6e1bd0-acde-43ff-9bb9-022691826d63 tempest-VolumesSnapshotsTestJSON-1753425842 tempest-VolumesSnapshotsTestJSON-1753425842-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/bc9b8813-c596-4f95-ad2e-f81be73f75b9" status: 200 len: 344 microversion: 2.1 time: 0.083058 Jun 06 10:38:11.840257 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 13/19] 10.222.0.42 () {58 vars in 1244 bytes} [Mon Jun 6 10:38:11 2022] GET /compute/v2.1/os-volumes/bc9b8813-c596-4f95-ad2e-f81be73f75b9 => generated 344 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 10:38:12.076027 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-c71e3536-a80d-4302-8336-192bdfae7711 tempest-DeleteServersTestJSON-1512496307 tempest-DeleteServersTestJSON-1512496307-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:38:12.076834 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-c71e3536-a80d-4302-8336-192bdfae7711 tempest-DeleteServersTestJSON-1512496307 tempest-DeleteServersTestJSON-1512496307-project] [instance: d0c59b89-6051-4967-81c6-1e9559a7d7b6] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:38:12.091585 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-c71e3536-a80d-4302-8336-192bdfae7711 tempest-DeleteServersTestJSON-1512496307 tempest-DeleteServersTestJSON-1512496307-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:38:12.093847 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-c71e3536-a80d-4302-8336-192bdfae7711 tempest-DeleteServersTestJSON-1512496307 tempest-DeleteServersTestJSON-1512496307-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:38:12.095522 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-c71e3536-a80d-4302-8336-192bdfae7711 tempest-DeleteServersTestJSON-1512496307 tempest-DeleteServersTestJSON-1512496307-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:38:12.099658 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-c71e3536-a80d-4302-8336-192bdfae7711 tempest-DeleteServersTestJSON-1512496307 tempest-DeleteServersTestJSON-1512496307-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:38:12.606562 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-c71e3536-a80d-4302-8336-192bdfae7711 tempest-DeleteServersTestJSON-1512496307 tempest-DeleteServersTestJSON-1512496307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bbc3cd193444a65861f6e6705fd32cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8486d765afed40dc8795c7ba485d9535', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:38:12.617356 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-c71e3536-a80d-4302-8336-192bdfae7711 tempest-DeleteServersTestJSON-1512496307 tempest-DeleteServersTestJSON-1512496307-project] 10.222.0.42 "GET /compute/v2.1/servers/d0c59b89-6051-4967-81c6-1e9559a7d7b6" status: 200 len: 1273 microversion: 2.1 time: 0.546717 Jun 06 10:38:12.617943 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 7/20] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:38:12 2022] GET /compute/v2.1/servers/d0c59b89-6051-4967-81c6-1e9559a7d7b6 => generated 1273 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:38:12.852187 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-9bacbddb-81af-44a8-8361-9374600fa772 tempest-VolumesSnapshotsTestJSON-1753425842 tempest-VolumesSnapshotsTestJSON-1753425842-project] Calling method '.version_select at 0x7f8fd9715ca0>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:38:12.905139 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.wsgi [None req-9bacbddb-81af-44a8-8361-9374600fa772 tempest-VolumesSnapshotsTestJSON-1753425842 tempest-VolumesSnapshotsTestJSON-1753425842-project] HTTP exception thrown: Volume bc9b8813-c596-4f95-ad2e-f81be73f75b9 could not be found. Jun 06 10:38:12.908479 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-9bacbddb-81af-44a8-8361-9374600fa772 tempest-VolumesSnapshotsTestJSON-1753425842 tempest-VolumesSnapshotsTestJSON-1753425842-project] Request method failure captured: Jun 06 10:38:12.908479 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: request: GET /compute/v2.1/os-volumes/bc9b8813-c596-4f95-ad2e-f81be73f75b9 HTTP/1.1 Jun 06 10:38:12.908479 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: Accept: application/json Jun 06 10:38:12.908479 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: Accept-Encoding: identity Jun 06 10:38:12.908479 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: Connection: close Jun 06 10:38:12.908479 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: Content-Length: 0 Jun 06 10:38:12.908479 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: Content-Type: application/json Jun 06 10:38:12.908479 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: Host: 10.222.0.42 Jun 06 10:38:12.908479 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: Openstack-System-Scope: None Jun 06 10:38:12.908479 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: User-Agent: python-urllib3/1.26.9 Jun 06 10:38:12.908479 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Auth-Token: gAAAAABindkJC-moogO8ZNAffqsathgiag4nPXobelO6QUFLJhgi-TNuuwhGGhGnBRvN1swux2zLZjptm3wiJEz7vuY9Rd5Ji2KL8Cefd_HV8f6uF5FAYcwASHwa670PXHmFGg_SnTPwl0nCxKtFjdecrZtdcjIlb14GP1L71lCABkQywzTBY5o Jun 06 10:38:12.908479 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Domain-Id: None Jun 06 10:38:12.908479 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Domain-Name: None Jun 06 10:38:12.908479 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Identity-Status: Confirmed Jun 06 10:38:12.908479 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Is-Admin-Project: True Jun 06 10:38:12.908479 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Project-Domain-Id: default Jun 06 10:38:12.908479 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Project-Domain-Name: Default Jun 06 10:38:12.908479 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Project-Id: 3428f9ec1f0444e189b0d2c465f59419 Jun 06 10:38:12.908479 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1753425842 Jun 06 10:38:12.908479 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Role: member,reader Jun 06 10:38:12.908479 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Roles: member,reader Jun 06 10:38:12.909559 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/3428f9ec1f0444e189b0d2c465f59419"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/3428f9ec1f0444e189b0d2c465f59419"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/3428f9ec1f0444e189b0d2c465f59419"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_3428f9ec1f0444e189b0d2c465f59419", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Jun 06 10:38:12.909559 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1753425842 Jun 06 10:38:12.909559 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Tenant-Id: 3428f9ec1f0444e189b0d2c465f59419 Jun 06 10:38:12.909559 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1753425842 Jun 06 10:38:12.909559 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-User: tempest-VolumesSnapshotsTestJSON-1753425842-project Jun 06 10:38:12.909559 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-User-Domain-Id: default Jun 06 10:38:12.909559 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-User-Domain-Name: Default Jun 06 10:38:12.909559 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-User-Id: 749aa2ca183140e2a86d6be9aac6b4a4 Jun 06 10:38:12.909559 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1753425842-project Jun 06 10:38:12.909559 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: method: Jun 06 10:38:12.909559 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: exception: Volume bc9b8813-c596-4f95-ad2e-f81be73f75b9 could not be found. Jun 06 10:38:12.909559 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: action_args: {'id': 'bc9b8813-c596-4f95-ad2e-f81be73f75b9'} Jun 06 10:38:12.909559 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 10:38:12.910171 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 10:38:12.910171 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 06 10:38:12.910171 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 06 10:38:12.910171 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 06 10:38:12.910171 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 06 10:38:12.910171 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 06 10:38:12.910171 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 06 10:38:12.910171 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 06 10:38:12.910171 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 06 10:38:12.910171 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 06 10:38:12.910171 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 06 10:38:12.910171 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 06 10:38:12.910171 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 06 10:38:12.910171 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 06 10:38:12.910171 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 06 10:38:12.910171 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume bc9b8813-c596-4f95-ad2e-f81be73f75b9 could not be found. (HTTP 404) (Request-ID: req-99b20a57-5e0b-4c8b-bf65-b8d41d36f740) Jun 06 10:38:12.910171 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Jun 06 10:38:12.910171 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 10:38:12.910171 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Jun 06 10:38:12.911033 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 10:38:12.911033 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 06 10:38:12.911033 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 06 10:38:12.911033 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 06 10:38:12.911033 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 06 10:38:12.911033 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 06 10:38:12.911033 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 06 10:38:12.911033 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 06 10:38:12.911033 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 06 10:38:12.911033 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 06 10:38:12.911033 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 06 10:38:12.911033 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 06 10:38:12.911033 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 06 10:38:12.911033 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 06 10:38:12.911033 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 06 10:38:12.911033 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 06 10:38:12.911033 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 06 10:38:12.911033 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 06 10:38:12.911033 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 06 10:38:12.912032 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 06 10:38:12.912032 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 06 10:38:12.912032 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 06 10:38:12.912032 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 06 10:38:12.912032 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume bc9b8813-c596-4f95-ad2e-f81be73f75b9 could not be found. Jun 06 10:38:12.912032 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Jun 06 10:38:12.912032 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 10:38:12.912032 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Jun 06 10:38:12.912032 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 10:38:12.912032 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 10:38:12.912032 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 10:38:12.912032 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 10:38:12.912032 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 10:38:12.912032 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 06 10:38:12.912032 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 06 10:38:12.912032 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 10:38:12.912032 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 10:38:12.912032 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 06 10:38:12.912032 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 06 10:38:12.912894 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume bc9b8813-c596-4f95-ad2e-f81be73f75b9 could not be found. Jun 06 10:38:12.912894 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Jun 06 10:38:12.912894 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 10:38:12.912894 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Jun 06 10:38:12.912894 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 10:38:12.912894 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 10:38:12.912894 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 10:38:12.912894 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 10:38:12.912894 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 10:38:12.912894 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume bc9b8813-c596-4f95-ad2e-f81be73f75b9 could not be found. Jun 06 10:38:12.912894 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Jun 06 10:38:12.915076 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-9bacbddb-81af-44a8-8361-9374600fa772 tempest-VolumesSnapshotsTestJSON-1753425842 tempest-VolumesSnapshotsTestJSON-1753425842-project] Returning 404 to user: Volume bc9b8813-c596-4f95-ad2e-f81be73f75b9 could not be found. {{(pid=129349) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 10:38:12.916150 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-9bacbddb-81af-44a8-8361-9374600fa772 tempest-VolumesSnapshotsTestJSON-1753425842 tempest-VolumesSnapshotsTestJSON-1753425842-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/bc9b8813-c596-4f95-ad2e-f81be73f75b9" status: 404 len: 109 microversion: 2.1 time: 0.067828 Jun 06 10:38:12.927039 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-5a85e44d-56e5-4584-a9e5-f7e41f7cb92a tempest-VolumesSnapshotsTestJSON-1753425842 tempest-VolumesSnapshotsTestJSON-1753425842-project] Calling method '.version_select at 0x7f8fd85c99d0>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:38:12.930162 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 14/21] 10.222.0.42 () {58 vars in 1244 bytes} [Mon Jun 6 10:38:12 2022] GET /compute/v2.1/os-volumes/bc9b8813-c596-4f95-ad2e-f81be73f75b9 => generated 109 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 06 10:38:12.999027 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.wsgi [None req-5a85e44d-56e5-4584-a9e5-f7e41f7cb92a tempest-VolumesSnapshotsTestJSON-1753425842 tempest-VolumesSnapshotsTestJSON-1753425842-project] HTTP exception thrown: Volume bc9b8813-c596-4f95-ad2e-f81be73f75b9 could not be found. Jun 06 10:38:13.006230 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-5a85e44d-56e5-4584-a9e5-f7e41f7cb92a tempest-VolumesSnapshotsTestJSON-1753425842 tempest-VolumesSnapshotsTestJSON-1753425842-project] Request method failure captured: Jun 06 10:38:13.006230 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: request: DELETE /compute/v2.1/os-volumes/bc9b8813-c596-4f95-ad2e-f81be73f75b9 HTTP/1.1 Jun 06 10:38:13.006230 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: Accept: application/json Jun 06 10:38:13.006230 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: Accept-Encoding: identity Jun 06 10:38:13.006230 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: Connection: close Jun 06 10:38:13.006230 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: Content-Length: 0 Jun 06 10:38:13.006230 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: Content-Type: application/json Jun 06 10:38:13.006230 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: Host: 10.222.0.42 Jun 06 10:38:13.006230 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: Openstack-System-Scope: None Jun 06 10:38:13.006230 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: User-Agent: python-urllib3/1.26.9 Jun 06 10:38:13.006230 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Auth-Token: gAAAAABindkJC-moogO8ZNAffqsathgiag4nPXobelO6QUFLJhgi-TNuuwhGGhGnBRvN1swux2zLZjptm3wiJEz7vuY9Rd5Ji2KL8Cefd_HV8f6uF5FAYcwASHwa670PXHmFGg_SnTPwl0nCxKtFjdecrZtdcjIlb14GP1L71lCABkQywzTBY5o Jun 06 10:38:13.006230 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Domain-Id: None Jun 06 10:38:13.006230 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Domain-Name: None Jun 06 10:38:13.006230 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Identity-Status: Confirmed Jun 06 10:38:13.006230 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Is-Admin-Project: True Jun 06 10:38:13.006230 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Project-Domain-Id: default Jun 06 10:38:13.006230 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Project-Domain-Name: Default Jun 06 10:38:13.006230 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Project-Id: 3428f9ec1f0444e189b0d2c465f59419 Jun 06 10:38:13.006230 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1753425842 Jun 06 10:38:13.006230 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Role: member,reader Jun 06 10:38:13.006230 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Roles: member,reader Jun 06 10:38:13.007261 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/3428f9ec1f0444e189b0d2c465f59419"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/3428f9ec1f0444e189b0d2c465f59419"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/3428f9ec1f0444e189b0d2c465f59419"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_3428f9ec1f0444e189b0d2c465f59419", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Jun 06 10:38:13.007261 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1753425842 Jun 06 10:38:13.007261 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Tenant-Id: 3428f9ec1f0444e189b0d2c465f59419 Jun 06 10:38:13.007261 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1753425842 Jun 06 10:38:13.007261 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-User: tempest-VolumesSnapshotsTestJSON-1753425842-project Jun 06 10:38:13.007261 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-User-Domain-Id: default Jun 06 10:38:13.007261 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-User-Domain-Name: Default Jun 06 10:38:13.007261 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-User-Id: 749aa2ca183140e2a86d6be9aac6b4a4 Jun 06 10:38:13.007261 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1753425842-project Jun 06 10:38:13.007261 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: method: Jun 06 10:38:13.007261 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: exception: Volume bc9b8813-c596-4f95-ad2e-f81be73f75b9 could not be found. Jun 06 10:38:13.007261 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: action_args: {'id': 'bc9b8813-c596-4f95-ad2e-f81be73f75b9'} Jun 06 10:38:13.007261 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 10:38:13.008012 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 10:38:13.008012 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 06 10:38:13.008012 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 06 10:38:13.008012 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 06 10:38:13.008012 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 06 10:38:13.008012 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 06 10:38:13.008012 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 06 10:38:13.008012 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 06 10:38:13.008012 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 06 10:38:13.008012 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 06 10:38:13.008012 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 06 10:38:13.008012 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 06 10:38:13.008012 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 06 10:38:13.008012 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 06 10:38:13.008012 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 06 10:38:13.008012 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume bc9b8813-c596-4f95-ad2e-f81be73f75b9 could not be found. (HTTP 404) (Request-ID: req-5c10084f-10e7-4c64-ae22-3323d9bb150e) Jun 06 10:38:13.008012 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi Jun 06 10:38:13.008012 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 10:38:13.008012 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi Jun 06 10:38:13.008923 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 10:38:13.008923 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 06 10:38:13.008923 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 06 10:38:13.008923 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 06 10:38:13.008923 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 06 10:38:13.008923 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 06 10:38:13.008923 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 06 10:38:13.008923 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 06 10:38:13.008923 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 06 10:38:13.008923 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 06 10:38:13.008923 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 06 10:38:13.008923 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 06 10:38:13.008923 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 06 10:38:13.008923 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 06 10:38:13.008923 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 06 10:38:13.008923 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 06 10:38:13.008923 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 06 10:38:13.008923 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 06 10:38:13.008923 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 06 10:38:13.009916 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 06 10:38:13.009916 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 06 10:38:13.009916 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 06 10:38:13.009916 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 06 10:38:13.009916 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume bc9b8813-c596-4f95-ad2e-f81be73f75b9 could not be found. Jun 06 10:38:13.009916 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi Jun 06 10:38:13.009916 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 10:38:13.009916 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi Jun 06 10:38:13.009916 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 10:38:13.009916 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 10:38:13.009916 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 10:38:13.009916 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 10:38:13.009916 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 10:38:13.009916 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 06 10:38:13.009916 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 06 10:38:13.009916 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 10:38:13.009916 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 10:38:13.009916 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 06 10:38:13.009916 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 06 10:38:13.010937 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume bc9b8813-c596-4f95-ad2e-f81be73f75b9 could not be found. Jun 06 10:38:13.010937 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi Jun 06 10:38:13.010937 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 10:38:13.010937 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi Jun 06 10:38:13.010937 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 10:38:13.010937 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 10:38:13.010937 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 10:38:13.010937 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 10:38:13.010937 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 10:38:13.010937 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume bc9b8813-c596-4f95-ad2e-f81be73f75b9 could not be found. Jun 06 10:38:13.010937 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi Jun 06 10:38:13.013304 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-5a85e44d-56e5-4584-a9e5-f7e41f7cb92a tempest-VolumesSnapshotsTestJSON-1753425842 tempest-VolumesSnapshotsTestJSON-1753425842-project] Returning 404 to user: Volume bc9b8813-c596-4f95-ad2e-f81be73f75b9 could not be found. {{(pid=129350) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 10:38:13.014368 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-5a85e44d-56e5-4584-a9e5-f7e41f7cb92a tempest-VolumesSnapshotsTestJSON-1753425842 tempest-VolumesSnapshotsTestJSON-1753425842-project] 10.222.0.42 "DELETE /compute/v2.1/os-volumes/bc9b8813-c596-4f95-ad2e-f81be73f75b9" status: 404 len: 109 microversion: 2.1 time: 0.091394 Jun 06 10:38:13.023762 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 8/22] 10.222.0.42 () {58 vars in 1247 bytes} [Mon Jun 6 10:38:12 2022] DELETE /compute/v2.1/os-volumes/bc9b8813-c596-4f95-ad2e-f81be73f75b9 => generated 109 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 06 10:38:13.030301 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-0a22ab54-7092-4f7c-bd9c-24fa4c3b0ddf tempest-VolumesSnapshotsTestJSON-1753425842 tempest-VolumesSnapshotsTestJSON-1753425842-project] Calling method '.version_select at 0x7f8fd9715e50>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:38:13.121634 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.wsgi [None req-0a22ab54-7092-4f7c-bd9c-24fa4c3b0ddf tempest-VolumesSnapshotsTestJSON-1753425842 tempest-VolumesSnapshotsTestJSON-1753425842-project] HTTP exception thrown: Volume bc9b8813-c596-4f95-ad2e-f81be73f75b9 could not be found. Jun 06 10:38:13.123594 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-0a22ab54-7092-4f7c-bd9c-24fa4c3b0ddf tempest-VolumesSnapshotsTestJSON-1753425842 tempest-VolumesSnapshotsTestJSON-1753425842-project] Request method failure captured: Jun 06 10:38:13.123594 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: request: GET /compute/v2.1/os-volumes/bc9b8813-c596-4f95-ad2e-f81be73f75b9 HTTP/1.1 Jun 06 10:38:13.123594 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: Accept: application/json Jun 06 10:38:13.123594 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: Accept-Encoding: identity Jun 06 10:38:13.123594 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: Connection: close Jun 06 10:38:13.123594 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: Content-Length: 0 Jun 06 10:38:13.123594 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: Content-Type: application/json Jun 06 10:38:13.123594 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: Host: 10.222.0.42 Jun 06 10:38:13.123594 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: Openstack-System-Scope: None Jun 06 10:38:13.123594 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: User-Agent: python-urllib3/1.26.9 Jun 06 10:38:13.123594 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Auth-Token: gAAAAABindkJC-moogO8ZNAffqsathgiag4nPXobelO6QUFLJhgi-TNuuwhGGhGnBRvN1swux2zLZjptm3wiJEz7vuY9Rd5Ji2KL8Cefd_HV8f6uF5FAYcwASHwa670PXHmFGg_SnTPwl0nCxKtFjdecrZtdcjIlb14GP1L71lCABkQywzTBY5o Jun 06 10:38:13.123594 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Domain-Id: None Jun 06 10:38:13.123594 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Domain-Name: None Jun 06 10:38:13.123594 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Identity-Status: Confirmed Jun 06 10:38:13.123594 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Is-Admin-Project: True Jun 06 10:38:13.123594 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Project-Domain-Id: default Jun 06 10:38:13.123594 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Project-Domain-Name: Default Jun 06 10:38:13.123594 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Project-Id: 3428f9ec1f0444e189b0d2c465f59419 Jun 06 10:38:13.123594 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1753425842 Jun 06 10:38:13.123594 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Role: member,reader Jun 06 10:38:13.123594 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Roles: member,reader Jun 06 10:38:13.125210 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/3428f9ec1f0444e189b0d2c465f59419"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/3428f9ec1f0444e189b0d2c465f59419"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/3428f9ec1f0444e189b0d2c465f59419"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_3428f9ec1f0444e189b0d2c465f59419", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Jun 06 10:38:13.125210 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1753425842 Jun 06 10:38:13.125210 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Tenant-Id: 3428f9ec1f0444e189b0d2c465f59419 Jun 06 10:38:13.125210 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1753425842 Jun 06 10:38:13.125210 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-User: tempest-VolumesSnapshotsTestJSON-1753425842-project Jun 06 10:38:13.125210 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-User-Domain-Id: default Jun 06 10:38:13.125210 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-User-Domain-Name: Default Jun 06 10:38:13.125210 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-User-Id: 749aa2ca183140e2a86d6be9aac6b4a4 Jun 06 10:38:13.125210 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1753425842-project Jun 06 10:38:13.125210 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: method: Jun 06 10:38:13.125210 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: exception: Volume bc9b8813-c596-4f95-ad2e-f81be73f75b9 could not be found. Jun 06 10:38:13.125210 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: action_args: {'id': 'bc9b8813-c596-4f95-ad2e-f81be73f75b9'} Jun 06 10:38:13.125210 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 10:38:13.125986 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 10:38:13.125986 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 06 10:38:13.125986 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 06 10:38:13.125986 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 06 10:38:13.125986 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 06 10:38:13.125986 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 06 10:38:13.125986 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 06 10:38:13.125986 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 06 10:38:13.125986 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 06 10:38:13.125986 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 06 10:38:13.125986 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 06 10:38:13.125986 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 06 10:38:13.125986 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 06 10:38:13.125986 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 06 10:38:13.125986 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 06 10:38:13.125986 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume bc9b8813-c596-4f95-ad2e-f81be73f75b9 could not be found. (HTTP 404) (Request-ID: req-e52d0b6f-38bd-4bd1-b3a5-1c1d58ff11d8) Jun 06 10:38:13.125986 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Jun 06 10:38:13.125986 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 10:38:13.125986 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Jun 06 10:38:13.126877 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 10:38:13.126877 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 06 10:38:13.126877 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 06 10:38:13.126877 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 06 10:38:13.126877 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 06 10:38:13.126877 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 06 10:38:13.126877 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 06 10:38:13.126877 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 06 10:38:13.126877 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 06 10:38:13.126877 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 06 10:38:13.126877 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 06 10:38:13.126877 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 06 10:38:13.126877 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 06 10:38:13.126877 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 06 10:38:13.126877 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 06 10:38:13.126877 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 06 10:38:13.126877 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 06 10:38:13.126877 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 06 10:38:13.126877 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 06 10:38:13.130569 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 06 10:38:13.130569 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 06 10:38:13.130569 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 06 10:38:13.130569 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 06 10:38:13.130569 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume bc9b8813-c596-4f95-ad2e-f81be73f75b9 could not be found. Jun 06 10:38:13.130569 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Jun 06 10:38:13.130569 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 10:38:13.130569 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Jun 06 10:38:13.130569 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 10:38:13.130569 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 10:38:13.130569 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 10:38:13.130569 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 10:38:13.130569 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 10:38:13.130569 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 06 10:38:13.130569 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 06 10:38:13.130569 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 10:38:13.130569 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 10:38:13.130569 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 06 10:38:13.130569 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 06 10:38:13.136245 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume bc9b8813-c596-4f95-ad2e-f81be73f75b9 could not be found. Jun 06 10:38:13.136245 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Jun 06 10:38:13.136245 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 10:38:13.136245 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Jun 06 10:38:13.136245 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 10:38:13.136245 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 10:38:13.136245 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 10:38:13.136245 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 10:38:13.136245 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 10:38:13.136245 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume bc9b8813-c596-4f95-ad2e-f81be73f75b9 could not be found. Jun 06 10:38:13.136245 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Jun 06 10:38:13.136245 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-0a22ab54-7092-4f7c-bd9c-24fa4c3b0ddf tempest-VolumesSnapshotsTestJSON-1753425842 tempest-VolumesSnapshotsTestJSON-1753425842-project] Returning 404 to user: Volume bc9b8813-c596-4f95-ad2e-f81be73f75b9 could not be found. {{(pid=129349) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 10:38:13.136245 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-0a22ab54-7092-4f7c-bd9c-24fa4c3b0ddf tempest-VolumesSnapshotsTestJSON-1753425842 tempest-VolumesSnapshotsTestJSON-1753425842-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/bc9b8813-c596-4f95-ad2e-f81be73f75b9" status: 404 len: 109 microversion: 2.1 time: 0.106689 Jun 06 10:38:13.136245 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 15/23] 10.222.0.42 () {58 vars in 1244 bytes} [Mon Jun 6 10:38:13 2022] GET /compute/v2.1/os-volumes/bc9b8813-c596-4f95-ad2e-f81be73f75b9 => generated 109 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 06 10:38:13.638332 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-699b2208-0a2e-4910-a123-919a0a9c1dd6 tempest-DeleteServersTestJSON-1512496307 tempest-DeleteServersTestJSON-1512496307-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:38:13.639149 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-699b2208-0a2e-4910-a123-919a0a9c1dd6 tempest-DeleteServersTestJSON-1512496307 tempest-DeleteServersTestJSON-1512496307-project] [instance: d0c59b89-6051-4967-81c6-1e9559a7d7b6] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:38:13.650913 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-699b2208-0a2e-4910-a123-919a0a9c1dd6 tempest-DeleteServersTestJSON-1512496307 tempest-DeleteServersTestJSON-1512496307-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:38:13.654107 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-699b2208-0a2e-4910-a123-919a0a9c1dd6 tempest-DeleteServersTestJSON-1512496307 tempest-DeleteServersTestJSON-1512496307-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:38:13.658014 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-699b2208-0a2e-4910-a123-919a0a9c1dd6 tempest-DeleteServersTestJSON-1512496307 tempest-DeleteServersTestJSON-1512496307-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:38:13.658888 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-699b2208-0a2e-4910-a123-919a0a9c1dd6 tempest-DeleteServersTestJSON-1512496307 tempest-DeleteServersTestJSON-1512496307-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:38:14.547028 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-97287fbb-91d2-4def-8502-d684b290b9e2 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Action: 'create', calling method: .version_select at 0x7f8fd85c9790>, body: {"keypair": {"name": "tempest-keypair-1188802404", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEihHmf7YMGhjnzRj+Cv61yzGtn7rRIIRr/9BqGBU1+MZ5eeQmX2vA9oVWYkEBOBRqp4C5DnaLshXii9zOO94UPCIRSOx3g8o2E61w5Ais/z6xSNsJBQFfL5ejWiTiWVhw=="}} {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 10:38:14.623683 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.quota [None req-97287fbb-91d2-4def-8502-d684b290b9e2 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Getting quotas for project fe30c756a2f84166ad23af1edf83157e. Resources: {'key_pairs'} {{(pid=129350) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 06 10:38:14.642487 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.quota [None req-97287fbb-91d2-4def-8502-d684b290b9e2 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Getting quotas for user f6b7d82c999646b6b6b96d565f0e3f9a and project fe30c756a2f84166ad23af1edf83157e. Resources: {'key_pairs'} {{(pid=129350) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 06 10:38:14.717536 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-97287fbb-91d2-4def-8502-d684b290b9e2 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.346698 Jun 06 10:38:14.725306 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 9/24] 10.222.0.42 () {60 vars in 1158 bytes} [Mon Jun 6 10:38:13 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1356 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 10:38:15.394103 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-699b2208-0a2e-4910-a123-919a0a9c1dd6 tempest-DeleteServersTestJSON-1512496307 tempest-DeleteServersTestJSON-1512496307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bbc3cd193444a65861f6e6705fd32cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8486d765afed40dc8795c7ba485d9535', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:38:15.411096 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-699b2208-0a2e-4910-a123-919a0a9c1dd6 tempest-DeleteServersTestJSON-1512496307 tempest-DeleteServersTestJSON-1512496307-project] 10.222.0.42 "GET /compute/v2.1/servers/d0c59b89-6051-4967-81c6-1e9559a7d7b6" status: 200 len: 1273 microversion: 2.1 time: 1.777215 Jun 06 10:38:15.424377 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 16/25] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:38:13 2022] GET /compute/v2.1/servers/d0c59b89-6051-4967-81c6-1e9559a7d7b6 => generated 1273 bytes in 1792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:38:16.429636 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-717dfa0e-880b-4688-b5ab-51c50cda31ae tempest-DeleteServersTestJSON-1512496307 tempest-DeleteServersTestJSON-1512496307-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:38:16.431305 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-717dfa0e-880b-4688-b5ab-51c50cda31ae tempest-DeleteServersTestJSON-1512496307 tempest-DeleteServersTestJSON-1512496307-project] [instance: d0c59b89-6051-4967-81c6-1e9559a7d7b6] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:38:16.462549 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-717dfa0e-880b-4688-b5ab-51c50cda31ae tempest-DeleteServersTestJSON-1512496307 tempest-DeleteServersTestJSON-1512496307-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:38:16.466125 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-717dfa0e-880b-4688-b5ab-51c50cda31ae tempest-DeleteServersTestJSON-1512496307 tempest-DeleteServersTestJSON-1512496307-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:38:16.467076 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-717dfa0e-880b-4688-b5ab-51c50cda31ae tempest-DeleteServersTestJSON-1512496307 tempest-DeleteServersTestJSON-1512496307-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:38:16.470649 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-717dfa0e-880b-4688-b5ab-51c50cda31ae tempest-DeleteServersTestJSON-1512496307 tempest-DeleteServersTestJSON-1512496307-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:38:16.906235 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-717dfa0e-880b-4688-b5ab-51c50cda31ae tempest-DeleteServersTestJSON-1512496307 tempest-DeleteServersTestJSON-1512496307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bbc3cd193444a65861f6e6705fd32cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8486d765afed40dc8795c7ba485d9535', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:38:16.919720 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-717dfa0e-880b-4688-b5ab-51c50cda31ae tempest-DeleteServersTestJSON-1512496307 tempest-DeleteServersTestJSON-1512496307-project] 10.222.0.42 "GET /compute/v2.1/servers/d0c59b89-6051-4967-81c6-1e9559a7d7b6" status: 200 len: 1315 microversion: 2.1 time: 0.494290 Jun 06 10:38:16.920715 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 10/26] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:38:16 2022] GET /compute/v2.1/servers/d0c59b89-6051-4967-81c6-1e9559a7d7b6 => generated 1315 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:38:17.938333 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-b1a5f845-3b60-4211-aa00-0b0dcdcc08ac tempest-DeleteServersTestJSON-1512496307 tempest-DeleteServersTestJSON-1512496307-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:38:17.939007 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-b1a5f845-3b60-4211-aa00-0b0dcdcc08ac tempest-DeleteServersTestJSON-1512496307 tempest-DeleteServersTestJSON-1512496307-project] [instance: d0c59b89-6051-4967-81c6-1e9559a7d7b6] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:38:17.962754 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-b1a5f845-3b60-4211-aa00-0b0dcdcc08ac tempest-DeleteServersTestJSON-1512496307 tempest-DeleteServersTestJSON-1512496307-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:38:17.963227 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-b1a5f845-3b60-4211-aa00-0b0dcdcc08ac tempest-DeleteServersTestJSON-1512496307 tempest-DeleteServersTestJSON-1512496307-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:38:17.964069 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-b1a5f845-3b60-4211-aa00-0b0dcdcc08ac tempest-DeleteServersTestJSON-1512496307 tempest-DeleteServersTestJSON-1512496307-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:38:17.964530 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-b1a5f845-3b60-4211-aa00-0b0dcdcc08ac tempest-DeleteServersTestJSON-1512496307 tempest-DeleteServersTestJSON-1512496307-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:38:18.876361 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-b1a5f845-3b60-4211-aa00-0b0dcdcc08ac tempest-DeleteServersTestJSON-1512496307 tempest-DeleteServersTestJSON-1512496307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bbc3cd193444a65861f6e6705fd32cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8486d765afed40dc8795c7ba485d9535', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:38:18.887764 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-b1a5f845-3b60-4211-aa00-0b0dcdcc08ac tempest-DeleteServersTestJSON-1512496307 tempest-DeleteServersTestJSON-1512496307-project] 10.222.0.42 "GET /compute/v2.1/servers/d0c59b89-6051-4967-81c6-1e9559a7d7b6" status: 200 len: 1315 microversion: 2.1 time: 0.953784 Jun 06 10:38:18.896541 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 17/27] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:38:17 2022] GET /compute/v2.1/servers/d0c59b89-6051-4967-81c6-1e9559a7d7b6 => generated 1315 bytes in 963 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:38:19.911908 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-fe21f79a-36b9-4c54-ab9b-d200621eb5d0 tempest-DeleteServersTestJSON-1512496307 tempest-DeleteServersTestJSON-1512496307-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:38:19.912538 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-fe21f79a-36b9-4c54-ab9b-d200621eb5d0 tempest-DeleteServersTestJSON-1512496307 tempest-DeleteServersTestJSON-1512496307-project] [instance: d0c59b89-6051-4967-81c6-1e9559a7d7b6] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:38:19.917473 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG dbcounter [-] [129350] Writing DB stats nova_cell0:SELECT=2 {{(pid=129350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 10:38:19.938315 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-fe21f79a-36b9-4c54-ab9b-d200621eb5d0 tempest-DeleteServersTestJSON-1512496307 tempest-DeleteServersTestJSON-1512496307-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:38:19.940184 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-fe21f79a-36b9-4c54-ab9b-d200621eb5d0 tempest-DeleteServersTestJSON-1512496307 tempest-DeleteServersTestJSON-1512496307-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:38:19.944501 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-fe21f79a-36b9-4c54-ab9b-d200621eb5d0 tempest-DeleteServersTestJSON-1512496307 tempest-DeleteServersTestJSON-1512496307-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:38:19.948105 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-fe21f79a-36b9-4c54-ab9b-d200621eb5d0 tempest-DeleteServersTestJSON-1512496307 tempest-DeleteServersTestJSON-1512496307-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:38:21.191215 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-fe21f79a-36b9-4c54-ab9b-d200621eb5d0 tempest-DeleteServersTestJSON-1512496307 tempest-DeleteServersTestJSON-1512496307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bbc3cd193444a65861f6e6705fd32cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8486d765afed40dc8795c7ba485d9535', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:38:21.203572 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-fe21f79a-36b9-4c54-ab9b-d200621eb5d0 tempest-DeleteServersTestJSON-1512496307 tempest-DeleteServersTestJSON-1512496307-project] 10.222.0.42 "GET /compute/v2.1/servers/d0c59b89-6051-4967-81c6-1e9559a7d7b6" status: 200 len: 1315 microversion: 2.1 time: 1.298100 Jun 06 10:38:21.219554 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 11/28] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:38:19 2022] GET /compute/v2.1/servers/d0c59b89-6051-4967-81c6-1e9559a7d7b6 => generated 1315 bytes in 1315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:38:21.536133 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG dbcounter [-] [129349] Writing DB stats nova_cell0:SELECT=4 {{(pid=129349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 10:38:21.936644 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-6784be10-bda4-4965-9dd2-269372e69791 tempest-VolumesNegativeTest-2063228978 tempest-VolumesNegativeTest-2063228978-project] Action: 'create', calling method: .version_select at 0x7f8fd97caee0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1104221479", "metadata": {"Type": "work"}}} {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 10:38:21.949826 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-6784be10-bda4-4965-9dd2-269372e69791 tempest-VolumesNegativeTest-2063228978 tempest-VolumesNegativeTest-2063228978-project] Request method failure captured: Jun 06 10:38:21.949826 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 06 10:38:21.949826 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: Accept: application/json Jun 06 10:38:21.949826 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: Accept-Encoding: identity Jun 06 10:38:21.949826 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: Connection: close Jun 06 10:38:21.949826 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: Content-Length: 122 Jun 06 10:38:21.949826 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: Content-Type: application/json Jun 06 10:38:21.949826 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: Host: 10.222.0.42 Jun 06 10:38:21.949826 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: Openstack-System-Scope: None Jun 06 10:38:21.949826 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: User-Agent: python-urllib3/1.26.9 Jun 06 10:38:21.949826 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Auth-Token: gAAAAABindkdXM-jAppV73y9sZHNqHWqEdG4NktveJ2PLiEdvlbGoa6pEcrk4U-VLa48I3MyYJ1jgdYPtmTBFpCcf7WXdxzToFaObLjlgi0-1Bic67y0FKO1FC5dDwyIAVS8SLPc87woDomvehYwhySq0eKQffaqze4rUb5j0Wf1xIBN00A4Zp8 Jun 06 10:38:21.949826 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Domain-Id: None Jun 06 10:38:21.949826 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Domain-Name: None Jun 06 10:38:21.949826 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Identity-Status: Confirmed Jun 06 10:38:21.949826 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Is-Admin-Project: True Jun 06 10:38:21.949826 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Project-Domain-Id: default Jun 06 10:38:21.949826 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Project-Domain-Name: Default Jun 06 10:38:21.949826 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Project-Id: 4d89f821ea534751b38d212cf85490fa Jun 06 10:38:21.949826 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Project-Name: tempest-VolumesNegativeTest-2063228978 Jun 06 10:38:21.949826 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Role: member,reader Jun 06 10:38:21.949826 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Roles: member,reader Jun 06 10:38:21.951315 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/4d89f821ea534751b38d212cf85490fa"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4d89f821ea534751b38d212cf85490fa"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4d89f821ea534751b38d212cf85490fa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_4d89f821ea534751b38d212cf85490fa", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Jun 06 10:38:21.951315 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Tenant: tempest-VolumesNegativeTest-2063228978 Jun 06 10:38:21.951315 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Tenant-Id: 4d89f821ea534751b38d212cf85490fa Jun 06 10:38:21.951315 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Tenant-Name: tempest-VolumesNegativeTest-2063228978 Jun 06 10:38:21.951315 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-User: tempest-VolumesNegativeTest-2063228978-project Jun 06 10:38:21.951315 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-User-Domain-Id: default Jun 06 10:38:21.951315 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-User-Domain-Name: Default Jun 06 10:38:21.951315 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-User-Id: e84e9b531eca460682dc3b5b730b9a14 Jun 06 10:38:21.951315 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-User-Name: tempest-VolumesNegativeTest-2063228978-project Jun 06 10:38:21.951315 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: Jun 06 10:38:21.951315 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1104221479", "metadata": {"Type": "work"}}} Jun 06 10:38:21.951315 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: method: Jun 06 10:38:21.951315 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 06 10:38:21.953230 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1104221479', 'metadata': {'Type': 'work'}}}} Jun 06 10:38:21.953230 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 10:38:21.953230 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 10:38:21.953230 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 06 10:38:21.953230 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 06 10:38:21.953230 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 06 10:38:21.953230 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi raise error Jun 06 10:38:21.953230 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jun 06 10:38:21.953230 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Jun 06 10:38:21.953230 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 06 10:38:21.953230 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 06 10:38:21.953230 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Jun 06 10:38:21.953230 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 06 10:38:21.953230 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi '#$%' Jun 06 10:38:21.953230 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Jun 06 10:38:21.953230 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 10:38:21.953230 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Jun 06 10:38:21.953230 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 10:38:21.953230 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 10:38:21.953230 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 10:38:21.953230 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 10:38:21.953230 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 10:38:21.954782 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 06 10:38:21.954782 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 06 10:38:21.954782 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 10:38:21.954782 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 10:38:21.954782 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 06 10:38:21.954782 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 06 10:38:21.954782 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 06 10:38:21.954782 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 06 10:38:21.954782 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 06 10:38:21.954782 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 06 10:38:21.954782 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 06 10:38:21.954782 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Jun 06 10:38:21.954782 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 10:38:21.954782 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Jun 06 10:38:21.954782 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 10:38:21.954782 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 10:38:21.954782 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 10:38:21.954782 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 06 10:38:21.954782 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 06 10:38:21.955988 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 06 10:38:21.955988 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Jun 06 10:38:21.955988 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-6784be10-bda4-4965-9dd2-269372e69791 tempest-VolumesNegativeTest-2063228978 tempest-VolumesNegativeTest-2063228978-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=129349) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 10:38:21.955988 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-6784be10-bda4-4965-9dd2-269372e69791 tempest-VolumesNegativeTest-2063228978 tempest-VolumesNegativeTest-2063228978-project] 10.222.0.42 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.424899 Jun 06 10:38:21.957894 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 18/29] 10.222.0.42 () {60 vars in 1155 bytes} [Mon Jun 6 10:38:21 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 432 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 06 10:38:21.977645 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-a6557534-f126-4e62-9a23-583101c47a31 tempest-VolumesNegativeTest-2063228978 tempest-VolumesNegativeTest-2063228978-project] Action: 'create', calling method: .version_select at 0x7f8fd965d550>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1769167609", "metadata": {"Type": "work"}}} {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 10:38:21.995261 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-a6557534-f126-4e62-9a23-583101c47a31 tempest-VolumesNegativeTest-2063228978 tempest-VolumesNegativeTest-2063228978-project] Request method failure captured: Jun 06 10:38:21.995261 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 06 10:38:21.995261 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: Accept: application/json Jun 06 10:38:21.995261 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: Accept-Encoding: identity Jun 06 10:38:21.995261 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: Connection: close Jun 06 10:38:21.995261 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: Content-Length: 120 Jun 06 10:38:21.995261 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: Content-Type: application/json Jun 06 10:38:21.995261 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: Host: 10.222.0.42 Jun 06 10:38:21.995261 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: Openstack-System-Scope: None Jun 06 10:38:21.995261 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: User-Agent: python-urllib3/1.26.9 Jun 06 10:38:21.995261 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Auth-Token: gAAAAABindkdXM-jAppV73y9sZHNqHWqEdG4NktveJ2PLiEdvlbGoa6pEcrk4U-VLa48I3MyYJ1jgdYPtmTBFpCcf7WXdxzToFaObLjlgi0-1Bic67y0FKO1FC5dDwyIAVS8SLPc87woDomvehYwhySq0eKQffaqze4rUb5j0Wf1xIBN00A4Zp8 Jun 06 10:38:21.995261 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Domain-Id: None Jun 06 10:38:21.995261 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Domain-Name: None Jun 06 10:38:21.995261 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Identity-Status: Confirmed Jun 06 10:38:21.995261 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Is-Admin-Project: True Jun 06 10:38:21.995261 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Project-Domain-Id: default Jun 06 10:38:21.995261 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Project-Domain-Name: Default Jun 06 10:38:21.995261 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Project-Id: 4d89f821ea534751b38d212cf85490fa Jun 06 10:38:21.995261 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Project-Name: tempest-VolumesNegativeTest-2063228978 Jun 06 10:38:21.995261 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Role: member,reader Jun 06 10:38:21.995261 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Roles: member,reader Jun 06 10:38:21.996468 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/4d89f821ea534751b38d212cf85490fa"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4d89f821ea534751b38d212cf85490fa"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4d89f821ea534751b38d212cf85490fa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_4d89f821ea534751b38d212cf85490fa", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Jun 06 10:38:21.996468 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Tenant: tempest-VolumesNegativeTest-2063228978 Jun 06 10:38:21.996468 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Tenant-Id: 4d89f821ea534751b38d212cf85490fa Jun 06 10:38:21.996468 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Tenant-Name: tempest-VolumesNegativeTest-2063228978 Jun 06 10:38:21.996468 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-User: tempest-VolumesNegativeTest-2063228978-project Jun 06 10:38:21.996468 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-User-Domain-Id: default Jun 06 10:38:21.996468 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-User-Domain-Name: Default Jun 06 10:38:21.996468 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-User-Id: e84e9b531eca460682dc3b5b730b9a14 Jun 06 10:38:21.996468 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-User-Name: tempest-VolumesNegativeTest-2063228978-project Jun 06 10:38:21.996468 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: Jun 06 10:38:21.996468 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1769167609", "metadata": {"Type": "work"}}} Jun 06 10:38:21.996468 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: method: Jun 06 10:38:21.996468 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 06 10:38:21.997127 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1769167609', 'metadata': {'Type': 'work'}}}} Jun 06 10:38:21.997127 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 10:38:21.997127 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 10:38:21.997127 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 06 10:38:21.997127 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 06 10:38:21.997127 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 06 10:38:21.997127 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi raise error Jun 06 10:38:21.997127 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jun 06 10:38:21.997127 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Jun 06 10:38:21.997127 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jun 06 10:38:21.997127 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 06 10:38:21.997127 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Jun 06 10:38:21.997127 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 06 10:38:21.997127 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi '0' Jun 06 10:38:21.997127 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Jun 06 10:38:21.997127 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 10:38:21.997127 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Jun 06 10:38:21.997127 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 10:38:21.997127 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 10:38:21.997127 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 10:38:21.997127 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 10:38:21.997127 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 10:38:21.998178 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 06 10:38:21.998178 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 06 10:38:21.998178 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 10:38:21.998178 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 10:38:21.998178 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 06 10:38:21.998178 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 06 10:38:21.998178 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 06 10:38:21.998178 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 06 10:38:21.998178 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 06 10:38:21.998178 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 06 10:38:21.998178 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 06 10:38:21.998178 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Jun 06 10:38:21.998178 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 10:38:21.998178 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Jun 06 10:38:21.998178 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 10:38:21.998178 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 10:38:21.998178 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 10:38:21.998178 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 06 10:38:21.998178 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 06 10:38:21.999590 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 06 10:38:21.999590 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Jun 06 10:38:22.004335 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-a6557534-f126-4e62-9a23-583101c47a31 tempest-VolumesNegativeTest-2063228978 tempest-VolumesNegativeTest-2063228978-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=129349) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 10:38:22.007468 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-a6557534-f126-4e62-9a23-583101c47a31 tempest-VolumesNegativeTest-2063228978 tempest-VolumesNegativeTest-2063228978-project] 10.222.0.42 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.043105 Jun 06 10:38:22.011923 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 19/30] 10.222.0.42 () {60 vars in 1155 bytes} [Mon Jun 6 10:38:21 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 50 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 06 10:38:22.042019 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-f9f4deb2-730d-45a7-ae6e-b72cf6a62099 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1726492406", "imageRef": "6eea2d98-354d-4083-b74c-abcbb97f9e1a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 10:38:22.049072 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-f8137f15-cfd6-4d38-9865-696c378d68c5 tempest-VolumesNegativeTest-2063228978 tempest-VolumesNegativeTest-2063228978-project] Action: 'create', calling method: .version_select at 0x7f8fd9726040>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-506326397", "metadata": {"Type": "work"}}} {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 10:38:22.056278 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-f8137f15-cfd6-4d38-9865-696c378d68c5 tempest-VolumesNegativeTest-2063228978 tempest-VolumesNegativeTest-2063228978-project] Request method failure captured: Jun 06 10:38:22.056278 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 06 10:38:22.056278 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: Accept: application/json Jun 06 10:38:22.056278 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: Accept-Encoding: identity Jun 06 10:38:22.056278 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: Connection: close Jun 06 10:38:22.056278 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: Content-Length: 118 Jun 06 10:38:22.056278 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: Content-Type: application/json Jun 06 10:38:22.056278 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: Host: 10.222.0.42 Jun 06 10:38:22.056278 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: Openstack-System-Scope: None Jun 06 10:38:22.056278 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: User-Agent: python-urllib3/1.26.9 Jun 06 10:38:22.056278 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Auth-Token: gAAAAABindkdXM-jAppV73y9sZHNqHWqEdG4NktveJ2PLiEdvlbGoa6pEcrk4U-VLa48I3MyYJ1jgdYPtmTBFpCcf7WXdxzToFaObLjlgi0-1Bic67y0FKO1FC5dDwyIAVS8SLPc87woDomvehYwhySq0eKQffaqze4rUb5j0Wf1xIBN00A4Zp8 Jun 06 10:38:22.056278 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Domain-Id: None Jun 06 10:38:22.056278 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Domain-Name: None Jun 06 10:38:22.056278 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Identity-Status: Confirmed Jun 06 10:38:22.056278 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Is-Admin-Project: True Jun 06 10:38:22.056278 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Project-Domain-Id: default Jun 06 10:38:22.056278 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Project-Domain-Name: Default Jun 06 10:38:22.056278 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Project-Id: 4d89f821ea534751b38d212cf85490fa Jun 06 10:38:22.056278 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Project-Name: tempest-VolumesNegativeTest-2063228978 Jun 06 10:38:22.056278 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Role: member,reader Jun 06 10:38:22.056278 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Roles: member,reader Jun 06 10:38:22.057421 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/4d89f821ea534751b38d212cf85490fa"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4d89f821ea534751b38d212cf85490fa"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4d89f821ea534751b38d212cf85490fa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_4d89f821ea534751b38d212cf85490fa", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Jun 06 10:38:22.057421 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Tenant: tempest-VolumesNegativeTest-2063228978 Jun 06 10:38:22.057421 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Tenant-Id: 4d89f821ea534751b38d212cf85490fa Jun 06 10:38:22.057421 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Tenant-Name: tempest-VolumesNegativeTest-2063228978 Jun 06 10:38:22.057421 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-User: tempest-VolumesNegativeTest-2063228978-project Jun 06 10:38:22.057421 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-User-Domain-Id: default Jun 06 10:38:22.057421 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-User-Domain-Name: Default Jun 06 10:38:22.057421 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-User-Id: e84e9b531eca460682dc3b5b730b9a14 Jun 06 10:38:22.057421 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-User-Name: tempest-VolumesNegativeTest-2063228978-project Jun 06 10:38:22.057421 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: Jun 06 10:38:22.057421 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-506326397", "metadata": {"Type": "work"}}} Jun 06 10:38:22.057421 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: method: Jun 06 10:38:22.057421 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 06 10:38:22.058233 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-506326397', 'metadata': {'Type': 'work'}}}} Jun 06 10:38:22.058233 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 10:38:22.058233 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 10:38:22.058233 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 06 10:38:22.058233 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 06 10:38:22.058233 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 06 10:38:22.058233 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi raise error Jun 06 10:38:22.058233 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jun 06 10:38:22.058233 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Jun 06 10:38:22.058233 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 06 10:38:22.058233 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 06 10:38:22.058233 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Jun 06 10:38:22.058233 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 06 10:38:22.058233 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi '' Jun 06 10:38:22.058233 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Jun 06 10:38:22.058233 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 10:38:22.058233 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Jun 06 10:38:22.058233 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 10:38:22.058233 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 10:38:22.058233 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 10:38:22.058233 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 10:38:22.058233 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 10:38:22.059546 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 06 10:38:22.059546 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 06 10:38:22.059546 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 10:38:22.059546 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 10:38:22.059546 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 06 10:38:22.059546 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 06 10:38:22.059546 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 06 10:38:22.059546 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 06 10:38:22.059546 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 06 10:38:22.059546 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 06 10:38:22.059546 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 06 10:38:22.059546 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Jun 06 10:38:22.059546 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 10:38:22.059546 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Jun 06 10:38:22.059546 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 10:38:22.059546 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 10:38:22.059546 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 10:38:22.059546 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 06 10:38:22.059546 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 06 10:38:22.062404 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 06 10:38:22.062404 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Jun 06 10:38:22.064557 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-f8137f15-cfd6-4d38-9865-696c378d68c5 tempest-VolumesNegativeTest-2063228978 tempest-VolumesNegativeTest-2063228978-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=129349) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 10:38:22.065743 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-f8137f15-cfd6-4d38-9865-696c378d68c5 tempest-VolumesNegativeTest-2063228978 tempest-VolumesNegativeTest-2063228978-project] 10.222.0.42 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.027929 Jun 06 10:38:22.068498 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 20/31] 10.222.0.42 () {60 vars in 1155 bytes} [Mon Jun 6 10:38:22 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 34 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 06 10:38:22.098237 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-6c813006-3bd6-4bf7-bc52-390bd68db39d tempest-VolumesNegativeTest-2063228978 tempest-VolumesNegativeTest-2063228978-project] Calling method '.version_select at 0x7f8fd9715940>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:38:22.180111 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.network.neutron [None req-f9f4deb2-730d-45a7-ae6e-b72cf6a62099 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] validate_networks() for [('da9f0b74-ba8e-4c64-8104-9e13c79c47b6', None, None, None, None, None)] {{(pid=129350) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 06 10:38:22.212657 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.wsgi [None req-6c813006-3bd6-4bf7-bc52-390bd68db39d tempest-VolumesNegativeTest-2063228978 tempest-VolumesNegativeTest-2063228978-project] HTTP exception thrown: Volume tempest-invalid-120835285 could not be found. Jun 06 10:38:22.215573 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-6c813006-3bd6-4bf7-bc52-390bd68db39d tempest-VolumesNegativeTest-2063228978 tempest-VolumesNegativeTest-2063228978-project] Request method failure captured: Jun 06 10:38:22.215573 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-120835285 HTTP/1.1 Jun 06 10:38:22.215573 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: Accept: application/json Jun 06 10:38:22.215573 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: Accept-Encoding: identity Jun 06 10:38:22.215573 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: Connection: close Jun 06 10:38:22.215573 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: Content-Length: 0 Jun 06 10:38:22.215573 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: Content-Type: application/json Jun 06 10:38:22.215573 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: Host: 10.222.0.42 Jun 06 10:38:22.215573 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: Openstack-System-Scope: None Jun 06 10:38:22.215573 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: User-Agent: python-urllib3/1.26.9 Jun 06 10:38:22.215573 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Auth-Token: gAAAAABindkdXM-jAppV73y9sZHNqHWqEdG4NktveJ2PLiEdvlbGoa6pEcrk4U-VLa48I3MyYJ1jgdYPtmTBFpCcf7WXdxzToFaObLjlgi0-1Bic67y0FKO1FC5dDwyIAVS8SLPc87woDomvehYwhySq0eKQffaqze4rUb5j0Wf1xIBN00A4Zp8 Jun 06 10:38:22.215573 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Domain-Id: None Jun 06 10:38:22.215573 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Domain-Name: None Jun 06 10:38:22.215573 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Identity-Status: Confirmed Jun 06 10:38:22.215573 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Is-Admin-Project: True Jun 06 10:38:22.215573 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Project-Domain-Id: default Jun 06 10:38:22.215573 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Project-Domain-Name: Default Jun 06 10:38:22.215573 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Project-Id: 4d89f821ea534751b38d212cf85490fa Jun 06 10:38:22.215573 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Project-Name: tempest-VolumesNegativeTest-2063228978 Jun 06 10:38:22.215573 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Role: member,reader Jun 06 10:38:22.215573 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Roles: member,reader Jun 06 10:38:22.217161 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/4d89f821ea534751b38d212cf85490fa"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4d89f821ea534751b38d212cf85490fa"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4d89f821ea534751b38d212cf85490fa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_4d89f821ea534751b38d212cf85490fa", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Jun 06 10:38:22.217161 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Tenant: tempest-VolumesNegativeTest-2063228978 Jun 06 10:38:22.217161 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Tenant-Id: 4d89f821ea534751b38d212cf85490fa Jun 06 10:38:22.217161 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Tenant-Name: tempest-VolumesNegativeTest-2063228978 Jun 06 10:38:22.217161 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-User: tempest-VolumesNegativeTest-2063228978-project Jun 06 10:38:22.217161 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-User-Domain-Id: default Jun 06 10:38:22.217161 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-User-Domain-Name: Default Jun 06 10:38:22.217161 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-User-Id: e84e9b531eca460682dc3b5b730b9a14 Jun 06 10:38:22.217161 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-User-Name: tempest-VolumesNegativeTest-2063228978-project Jun 06 10:38:22.217161 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: method: Jun 06 10:38:22.217161 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: exception: Volume tempest-invalid-120835285 could not be found. Jun 06 10:38:22.217161 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: action_args: {'id': 'tempest-invalid-120835285'} Jun 06 10:38:22.217161 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 10:38:22.218811 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 10:38:22.218811 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 06 10:38:22.218811 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 06 10:38:22.218811 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 06 10:38:22.218811 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 06 10:38:22.218811 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 06 10:38:22.218811 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 06 10:38:22.218811 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 06 10:38:22.218811 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 06 10:38:22.218811 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 06 10:38:22.218811 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 06 10:38:22.218811 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 06 10:38:22.218811 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 06 10:38:22.218811 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 06 10:38:22.218811 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 06 10:38:22.218811 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-120835285 could not be found. (HTTP 404) (Request-ID: req-2a74f382-0329-4837-82c2-0e3da18ebd38) Jun 06 10:38:22.218811 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Jun 06 10:38:22.218811 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 10:38:22.218811 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Jun 06 10:38:22.219851 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 10:38:22.219851 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 06 10:38:22.219851 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 06 10:38:22.219851 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 06 10:38:22.219851 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 06 10:38:22.219851 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 06 10:38:22.219851 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 06 10:38:22.219851 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 06 10:38:22.219851 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 06 10:38:22.219851 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 06 10:38:22.219851 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 06 10:38:22.219851 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 06 10:38:22.219851 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 06 10:38:22.219851 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 06 10:38:22.219851 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 06 10:38:22.219851 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 06 10:38:22.219851 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 06 10:38:22.219851 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 06 10:38:22.219851 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 06 10:38:22.220795 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 06 10:38:22.220795 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 06 10:38:22.220795 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 06 10:38:22.220795 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 06 10:38:22.220795 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-120835285 could not be found. Jun 06 10:38:22.220795 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Jun 06 10:38:22.220795 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 10:38:22.220795 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Jun 06 10:38:22.220795 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 10:38:22.220795 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 10:38:22.220795 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 10:38:22.220795 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 10:38:22.220795 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 10:38:22.220795 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 06 10:38:22.220795 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 06 10:38:22.220795 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 10:38:22.220795 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 10:38:22.220795 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 06 10:38:22.220795 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 06 10:38:22.220795 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-120835285 could not be found. Jun 06 10:38:22.221812 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Jun 06 10:38:22.221812 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 10:38:22.221812 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Jun 06 10:38:22.221812 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 10:38:22.221812 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 10:38:22.221812 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 10:38:22.221812 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 10:38:22.221812 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 10:38:22.221812 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-120835285 could not be found. Jun 06 10:38:22.221812 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Jun 06 10:38:22.234645 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-6c813006-3bd6-4bf7-bc52-390bd68db39d tempest-VolumesNegativeTest-2063228978 tempest-VolumesNegativeTest-2063228978-project] Returning 404 to user: Volume tempest-invalid-120835285 could not be found. {{(pid=129349) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 10:38:22.235729 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-6c813006-3bd6-4bf7-bc52-390bd68db39d tempest-VolumesNegativeTest-2063228978 tempest-VolumesNegativeTest-2063228978-project] 10.222.0.42 "DELETE /compute/v2.1/os-volumes/tempest-invalid-120835285" status: 404 len: 98 microversion: 2.1 time: 0.146721 Jun 06 10:38:22.236573 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 21/32] 10.222.0.42 () {58 vars in 1214 bytes} [Mon Jun 6 10:38:22 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-120835285 => generated 98 bytes in 148 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 06 10:38:22.384440 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [req-0ee1a45a-1a93-4787-b27d-030c34c1efa8 req-3d9cf660-2108-4b99-aeba-519200433a2a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d0c59b89-6051-4967-81c6-1e9559a7d7b6", "tag": "111884d2-003e-4adc-825c-d66d4bfa0c32"}]} {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 10:38:22.425883 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [req-0ee1a45a-1a93-4787-b27d-030c34c1efa8 req-3d9cf660-2108-4b99-aeba-519200433a2a service nova] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:38:22.426585 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [req-0ee1a45a-1a93-4787-b27d-030c34c1efa8 req-3d9cf660-2108-4b99-aeba-519200433a2a service nova] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:38:22.510786 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.compute.server_external_events [req-0ee1a45a-1a93-4787-b27d-030c34c1efa8 req-3d9cf660-2108-4b99-aeba-519200433a2a service nova] Creating event network-changed:111884d2-003e-4adc-825c-d66d4bfa0c32 for instance d0c59b89-6051-4967-81c6-1e9559a7d7b6 on hv-cinder-84482 Jun 06 10:38:22.515920 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [req-0ee1a45a-1a93-4787-b27d-030c34c1efa8 req-3d9cf660-2108-4b99-aeba-519200433a2a service nova] Acquired lock "compute-rpcapi-router" {{(pid=129349) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 06 10:38:22.520296 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-e2cf7142-7532-481f-a00d-a24920ae3d01 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:38:22.522436 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-e2cf7142-7532-481f-a00d-a24920ae3d01 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:38:22.523609 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-e2cf7142-7532-481f-a00d-a24920ae3d01 None None] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:38:22.526112 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-e2cf7142-7532-481f-a00d-a24920ae3d01 None None] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:38:22.564939 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.compute.rpcapi [None req-e2cf7142-7532-481f-a00d-a24920ae3d01 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 06 10:38:22.568284 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-e2cf7142-7532-481f-a00d-a24920ae3d01 None None] Releasing lock "compute-rpcapi-router" {{(pid=129349) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 06 10:38:22.637715 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-e2cf7142-7532-481f-a00d-a24920ae3d01 None None] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.399729 Jun 06 10:38:22.640063 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 22/33] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Jun 6 10:38:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 10:38:22.648188 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-4af7e2c6-0e63-4063-8a58-95458f30fc6d tempest-DeleteServersTestJSON-1512496307 tempest-DeleteServersTestJSON-1512496307-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:38:22.648942 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-4af7e2c6-0e63-4063-8a58-95458f30fc6d tempest-DeleteServersTestJSON-1512496307 tempest-DeleteServersTestJSON-1512496307-project] [instance: d0c59b89-6051-4967-81c6-1e9559a7d7b6] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:38:22.666439 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-4af7e2c6-0e63-4063-8a58-95458f30fc6d tempest-DeleteServersTestJSON-1512496307 tempest-DeleteServersTestJSON-1512496307-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:38:22.667522 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-4af7e2c6-0e63-4063-8a58-95458f30fc6d tempest-DeleteServersTestJSON-1512496307 tempest-DeleteServersTestJSON-1512496307-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:38:22.668810 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-4af7e2c6-0e63-4063-8a58-95458f30fc6d tempest-DeleteServersTestJSON-1512496307 tempest-DeleteServersTestJSON-1512496307-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:38:22.672423 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-4af7e2c6-0e63-4063-8a58-95458f30fc6d tempest-DeleteServersTestJSON-1512496307 tempest-DeleteServersTestJSON-1512496307-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:38:24.022777 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-4af7e2c6-0e63-4063-8a58-95458f30fc6d tempest-DeleteServersTestJSON-1512496307 tempest-DeleteServersTestJSON-1512496307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bbc3cd193444a65861f6e6705fd32cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8486d765afed40dc8795c7ba485d9535', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:38:24.036415 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-4af7e2c6-0e63-4063-8a58-95458f30fc6d tempest-DeleteServersTestJSON-1512496307 tempest-DeleteServersTestJSON-1512496307-project] 10.222.0.42 "GET /compute/v2.1/servers/d0c59b89-6051-4967-81c6-1e9559a7d7b6" status: 200 len: 1315 microversion: 2.1 time: 1.390726 Jun 06 10:38:24.037305 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 23/34] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:38:22 2022] GET /compute/v2.1/servers/d0c59b89-6051-4967-81c6-1e9559a7d7b6 => generated 1315 bytes in 1396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:38:24.063933 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-44545fbd-5e6f-46ca-aa09-b91290a01325 tempest-VolumesNegativeTest-2063228978 tempest-VolumesNegativeTest-2063228978-project] 10.222.0.42 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.024475 Jun 06 10:38:24.071010 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 24/35] 10.222.0.42 () {58 vars in 1139 bytes} [Mon Jun 6 10:38:24 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 32 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jun 06 10:38:24.086494 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-5f52db8d-a248-4274-9db4-f542e11863ed tempest-VolumesNegativeTest-2063228978 tempest-VolumesNegativeTest-2063228978-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.012040 Jun 06 10:38:24.087448 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 25/36] 10.222.0.42 () {58 vars in 1136 bytes} [Mon Jun 6 10:38:24 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 16 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jun 06 10:38:24.106123 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-1baa7bc2-d4e2-4381-9fbd-689d5c5d82ee tempest-VolumesNegativeTest-2063228978 tempest-VolumesNegativeTest-2063228978-project] Calling method '.version_select at 0x7f8fd85b4e50>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:38:24.217700 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.wsgi [None req-1baa7bc2-d4e2-4381-9fbd-689d5c5d82ee tempest-VolumesNegativeTest-2063228978 tempest-VolumesNegativeTest-2063228978-project] HTTP exception thrown: Volume 7d748485-1a69-4e48-b4fe-67eea231814b could not be found. Jun 06 10:38:24.221907 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-1baa7bc2-d4e2-4381-9fbd-689d5c5d82ee tempest-VolumesNegativeTest-2063228978 tempest-VolumesNegativeTest-2063228978-project] Request method failure captured: Jun 06 10:38:24.221907 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: request: DELETE /compute/v2.1/os-volumes/7d748485-1a69-4e48-b4fe-67eea231814b HTTP/1.1 Jun 06 10:38:24.221907 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: Accept: application/json Jun 06 10:38:24.221907 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: Accept-Encoding: identity Jun 06 10:38:24.221907 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: Connection: close Jun 06 10:38:24.221907 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: Content-Length: 0 Jun 06 10:38:24.221907 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: Content-Type: application/json Jun 06 10:38:24.221907 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: Host: 10.222.0.42 Jun 06 10:38:24.221907 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: Openstack-System-Scope: None Jun 06 10:38:24.221907 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: User-Agent: python-urllib3/1.26.9 Jun 06 10:38:24.221907 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Auth-Token: gAAAAABindkdXM-jAppV73y9sZHNqHWqEdG4NktveJ2PLiEdvlbGoa6pEcrk4U-VLa48I3MyYJ1jgdYPtmTBFpCcf7WXdxzToFaObLjlgi0-1Bic67y0FKO1FC5dDwyIAVS8SLPc87woDomvehYwhySq0eKQffaqze4rUb5j0Wf1xIBN00A4Zp8 Jun 06 10:38:24.221907 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Domain-Id: None Jun 06 10:38:24.221907 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Domain-Name: None Jun 06 10:38:24.221907 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Identity-Status: Confirmed Jun 06 10:38:24.221907 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Is-Admin-Project: True Jun 06 10:38:24.221907 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Project-Domain-Id: default Jun 06 10:38:24.221907 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Project-Domain-Name: Default Jun 06 10:38:24.221907 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Project-Id: 4d89f821ea534751b38d212cf85490fa Jun 06 10:38:24.221907 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Project-Name: tempest-VolumesNegativeTest-2063228978 Jun 06 10:38:24.221907 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Role: member,reader Jun 06 10:38:24.221907 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Roles: member,reader Jun 06 10:38:24.223232 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/4d89f821ea534751b38d212cf85490fa"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4d89f821ea534751b38d212cf85490fa"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4d89f821ea534751b38d212cf85490fa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_4d89f821ea534751b38d212cf85490fa", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Jun 06 10:38:24.223232 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Tenant: tempest-VolumesNegativeTest-2063228978 Jun 06 10:38:24.223232 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Tenant-Id: 4d89f821ea534751b38d212cf85490fa Jun 06 10:38:24.223232 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Tenant-Name: tempest-VolumesNegativeTest-2063228978 Jun 06 10:38:24.223232 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-User: tempest-VolumesNegativeTest-2063228978-project Jun 06 10:38:24.223232 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-User-Domain-Id: default Jun 06 10:38:24.223232 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-User-Domain-Name: Default Jun 06 10:38:24.223232 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-User-Id: e84e9b531eca460682dc3b5b730b9a14 Jun 06 10:38:24.223232 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-User-Name: tempest-VolumesNegativeTest-2063228978-project Jun 06 10:38:24.223232 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: method: Jun 06 10:38:24.223232 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: exception: Volume 7d748485-1a69-4e48-b4fe-67eea231814b could not be found. Jun 06 10:38:24.223232 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: action_args: {'id': '7d748485-1a69-4e48-b4fe-67eea231814b'} Jun 06 10:38:24.223232 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 10:38:24.224577 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 10:38:24.224577 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 06 10:38:24.224577 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 06 10:38:24.224577 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 06 10:38:24.224577 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 06 10:38:24.224577 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 06 10:38:24.224577 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 06 10:38:24.224577 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 06 10:38:24.224577 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 06 10:38:24.224577 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 06 10:38:24.224577 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 06 10:38:24.224577 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 06 10:38:24.224577 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 06 10:38:24.224577 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 06 10:38:24.224577 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 06 10:38:24.224577 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 7d748485-1a69-4e48-b4fe-67eea231814b could not be found. (HTTP 404) (Request-ID: req-dd1b133e-8d98-4899-a201-bd19d93f92de) Jun 06 10:38:24.224577 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Jun 06 10:38:24.224577 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 10:38:24.224577 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Jun 06 10:38:24.226100 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 10:38:24.226100 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 06 10:38:24.226100 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 06 10:38:24.226100 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 06 10:38:24.226100 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 06 10:38:24.226100 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 06 10:38:24.226100 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 06 10:38:24.226100 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 06 10:38:24.226100 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 06 10:38:24.226100 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 06 10:38:24.226100 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 06 10:38:24.226100 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 06 10:38:24.226100 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 06 10:38:24.226100 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 06 10:38:24.226100 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 06 10:38:24.226100 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 06 10:38:24.226100 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 06 10:38:24.226100 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 06 10:38:24.226100 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 06 10:38:24.227246 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 06 10:38:24.227246 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 06 10:38:24.227246 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 06 10:38:24.227246 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 06 10:38:24.227246 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 7d748485-1a69-4e48-b4fe-67eea231814b could not be found. Jun 06 10:38:24.227246 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Jun 06 10:38:24.227246 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 10:38:24.227246 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Jun 06 10:38:24.227246 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 10:38:24.227246 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 10:38:24.227246 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 10:38:24.227246 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 10:38:24.227246 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 10:38:24.227246 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 06 10:38:24.227246 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 06 10:38:24.227246 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 10:38:24.227246 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 10:38:24.227246 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 06 10:38:24.227246 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 06 10:38:24.228451 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 7d748485-1a69-4e48-b4fe-67eea231814b could not be found. Jun 06 10:38:24.228451 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Jun 06 10:38:24.228451 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 10:38:24.228451 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Jun 06 10:38:24.228451 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 10:38:24.228451 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 10:38:24.228451 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 10:38:24.228451 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 10:38:24.228451 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 10:38:24.228451 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 7d748485-1a69-4e48-b4fe-67eea231814b could not be found. Jun 06 10:38:24.228451 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Jun 06 10:38:24.230516 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-1baa7bc2-d4e2-4381-9fbd-689d5c5d82ee tempest-VolumesNegativeTest-2063228978 tempest-VolumesNegativeTest-2063228978-project] Returning 404 to user: Volume 7d748485-1a69-4e48-b4fe-67eea231814b could not be found. {{(pid=129349) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 10:38:24.231533 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-1baa7bc2-d4e2-4381-9fbd-689d5c5d82ee tempest-VolumesNegativeTest-2063228978 tempest-VolumesNegativeTest-2063228978-project] 10.222.0.42 "DELETE /compute/v2.1/os-volumes/7d748485-1a69-4e48-b4fe-67eea231814b" status: 404 len: 109 microversion: 2.1 time: 0.137146 Jun 06 10:38:24.234190 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 26/37] 10.222.0.42 () {58 vars in 1247 bytes} [Mon Jun 6 10:38:24 2022] DELETE /compute/v2.1/os-volumes/7d748485-1a69-4e48-b4fe-67eea231814b => generated 109 bytes in 139 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 06 10:38:24.243514 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-8434d983-58f7-451e-939f-314ffe930bb2 tempest-VolumesNegativeTest-2063228978 tempest-VolumesNegativeTest-2063228978-project] Calling method '.version_select at 0x7f8fd85dc0d0>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:38:24.333705 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.wsgi [None req-8434d983-58f7-451e-939f-314ffe930bb2 tempest-VolumesNegativeTest-2063228978 tempest-VolumesNegativeTest-2063228978-project] HTTP exception thrown: Volume 812ceca9-d49b-4993-86ee-0af66890fd8f could not be found. Jun 06 10:38:24.336467 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-8434d983-58f7-451e-939f-314ffe930bb2 tempest-VolumesNegativeTest-2063228978 tempest-VolumesNegativeTest-2063228978-project] Request method failure captured: Jun 06 10:38:24.336467 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: request: GET /compute/v2.1/os-volumes/812ceca9-d49b-4993-86ee-0af66890fd8f HTTP/1.1 Jun 06 10:38:24.336467 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: Accept: application/json Jun 06 10:38:24.336467 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: Accept-Encoding: identity Jun 06 10:38:24.336467 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: Connection: close Jun 06 10:38:24.336467 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: Content-Length: 0 Jun 06 10:38:24.336467 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: Content-Type: application/json Jun 06 10:38:24.336467 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: Host: 10.222.0.42 Jun 06 10:38:24.336467 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: Openstack-System-Scope: None Jun 06 10:38:24.336467 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: User-Agent: python-urllib3/1.26.9 Jun 06 10:38:24.336467 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Auth-Token: gAAAAABindkdXM-jAppV73y9sZHNqHWqEdG4NktveJ2PLiEdvlbGoa6pEcrk4U-VLa48I3MyYJ1jgdYPtmTBFpCcf7WXdxzToFaObLjlgi0-1Bic67y0FKO1FC5dDwyIAVS8SLPc87woDomvehYwhySq0eKQffaqze4rUb5j0Wf1xIBN00A4Zp8 Jun 06 10:38:24.336467 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Domain-Id: None Jun 06 10:38:24.336467 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Domain-Name: None Jun 06 10:38:24.336467 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Identity-Status: Confirmed Jun 06 10:38:24.336467 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Is-Admin-Project: True Jun 06 10:38:24.336467 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Project-Domain-Id: default Jun 06 10:38:24.336467 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Project-Domain-Name: Default Jun 06 10:38:24.336467 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Project-Id: 4d89f821ea534751b38d212cf85490fa Jun 06 10:38:24.336467 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Project-Name: tempest-VolumesNegativeTest-2063228978 Jun 06 10:38:24.336467 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Role: member,reader Jun 06 10:38:24.336467 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Roles: member,reader Jun 06 10:38:24.337895 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/4d89f821ea534751b38d212cf85490fa"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4d89f821ea534751b38d212cf85490fa"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4d89f821ea534751b38d212cf85490fa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_4d89f821ea534751b38d212cf85490fa", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Jun 06 10:38:24.337895 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Tenant: tempest-VolumesNegativeTest-2063228978 Jun 06 10:38:24.337895 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Tenant-Id: 4d89f821ea534751b38d212cf85490fa Jun 06 10:38:24.337895 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Tenant-Name: tempest-VolumesNegativeTest-2063228978 Jun 06 10:38:24.337895 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-User: tempest-VolumesNegativeTest-2063228978-project Jun 06 10:38:24.337895 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-User-Domain-Id: default Jun 06 10:38:24.337895 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-User-Domain-Name: Default Jun 06 10:38:24.337895 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-User-Id: e84e9b531eca460682dc3b5b730b9a14 Jun 06 10:38:24.337895 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-User-Name: tempest-VolumesNegativeTest-2063228978-project Jun 06 10:38:24.337895 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: method: Jun 06 10:38:24.337895 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: exception: Volume 812ceca9-d49b-4993-86ee-0af66890fd8f could not be found. Jun 06 10:38:24.337895 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: action_args: {'id': '812ceca9-d49b-4993-86ee-0af66890fd8f'} Jun 06 10:38:24.337895 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 10:38:24.338878 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 10:38:24.338878 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 06 10:38:24.338878 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 06 10:38:24.338878 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 06 10:38:24.338878 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 06 10:38:24.338878 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 06 10:38:24.338878 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 06 10:38:24.338878 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 06 10:38:24.338878 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 06 10:38:24.338878 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 06 10:38:24.338878 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 06 10:38:24.338878 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 06 10:38:24.338878 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 06 10:38:24.338878 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 06 10:38:24.338878 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 06 10:38:24.338878 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 812ceca9-d49b-4993-86ee-0af66890fd8f could not be found. (HTTP 404) (Request-ID: req-24c58d59-0572-4a4a-906a-08b71dfa4d37) Jun 06 10:38:24.338878 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Jun 06 10:38:24.338878 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 10:38:24.338878 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Jun 06 10:38:24.340124 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 10:38:24.340124 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 06 10:38:24.340124 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 06 10:38:24.340124 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 06 10:38:24.340124 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 06 10:38:24.340124 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 06 10:38:24.340124 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 06 10:38:24.340124 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 06 10:38:24.340124 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 06 10:38:24.340124 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 06 10:38:24.340124 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 06 10:38:24.340124 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 06 10:38:24.340124 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 06 10:38:24.340124 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 06 10:38:24.340124 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 06 10:38:24.340124 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 06 10:38:24.340124 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 06 10:38:24.340124 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 06 10:38:24.340124 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 06 10:38:24.341232 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 06 10:38:24.341232 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 06 10:38:24.341232 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 06 10:38:24.341232 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 06 10:38:24.341232 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 812ceca9-d49b-4993-86ee-0af66890fd8f could not be found. Jun 06 10:38:24.341232 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Jun 06 10:38:24.341232 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 10:38:24.341232 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Jun 06 10:38:24.341232 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 10:38:24.341232 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 10:38:24.341232 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 10:38:24.341232 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 10:38:24.341232 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 10:38:24.341232 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 06 10:38:24.341232 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 06 10:38:24.341232 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 10:38:24.341232 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 10:38:24.341232 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 06 10:38:24.341232 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 06 10:38:24.343098 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 812ceca9-d49b-4993-86ee-0af66890fd8f could not be found. Jun 06 10:38:24.343098 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Jun 06 10:38:24.343098 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 10:38:24.343098 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Jun 06 10:38:24.343098 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 10:38:24.343098 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 10:38:24.343098 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 10:38:24.343098 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 10:38:24.343098 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 10:38:24.343098 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 812ceca9-d49b-4993-86ee-0af66890fd8f could not be found. Jun 06 10:38:24.343098 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Jun 06 10:38:24.346211 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-8434d983-58f7-451e-939f-314ffe930bb2 tempest-VolumesNegativeTest-2063228978 tempest-VolumesNegativeTest-2063228978-project] Returning 404 to user: Volume 812ceca9-d49b-4993-86ee-0af66890fd8f could not be found. {{(pid=129349) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 10:38:24.350794 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-8434d983-58f7-451e-939f-314ffe930bb2 tempest-VolumesNegativeTest-2063228978 tempest-VolumesNegativeTest-2063228978-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/812ceca9-d49b-4993-86ee-0af66890fd8f" status: 404 len: 109 microversion: 2.1 time: 0.108096 Jun 06 10:38:24.357639 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 27/38] 10.222.0.42 () {58 vars in 1244 bytes} [Mon Jun 6 10:38:24 2022] GET /compute/v2.1/os-volumes/812ceca9-d49b-4993-86ee-0af66890fd8f => generated 109 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 06 10:38:24.657877 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG dbcounter [-] [129350] Writing DB stats nova_cell0:SELECT=10 {{(pid=129350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 10:38:25.056113 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-ec925ff8-cae7-419d-8b79-2d5dfcf73492 tempest-DeleteServersTestJSON-1512496307 tempest-DeleteServersTestJSON-1512496307-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:38:25.057619 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-ec925ff8-cae7-419d-8b79-2d5dfcf73492 tempest-DeleteServersTestJSON-1512496307 tempest-DeleteServersTestJSON-1512496307-project] [instance: d0c59b89-6051-4967-81c6-1e9559a7d7b6] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:38:25.081957 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-ec925ff8-cae7-419d-8b79-2d5dfcf73492 tempest-DeleteServersTestJSON-1512496307 tempest-DeleteServersTestJSON-1512496307-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:38:25.084114 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-ec925ff8-cae7-419d-8b79-2d5dfcf73492 tempest-DeleteServersTestJSON-1512496307 tempest-DeleteServersTestJSON-1512496307-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:38:25.089417 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-ec925ff8-cae7-419d-8b79-2d5dfcf73492 tempest-DeleteServersTestJSON-1512496307 tempest-DeleteServersTestJSON-1512496307-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:38:25.095361 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-ec925ff8-cae7-419d-8b79-2d5dfcf73492 tempest-DeleteServersTestJSON-1512496307 tempest-DeleteServersTestJSON-1512496307-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:38:25.325079 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.virt.hardware [None req-f9f4deb2-730d-45a7-ae6e-b72cf6a62099 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Flavor limits 0:0:0 {{(pid=129350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 06 10:38:25.325508 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.virt.hardware [None req-f9f4deb2-730d-45a7-ae6e-b72cf6a62099 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Image limits 0:0:0 {{(pid=129350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 06 10:38:25.325980 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.virt.hardware [None req-f9f4deb2-730d-45a7-ae6e-b72cf6a62099 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Flavor pref 0:0:0 {{(pid=129350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 06 10:38:25.326569 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.virt.hardware [None req-f9f4deb2-730d-45a7-ae6e-b72cf6a62099 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Image pref 0:0:0 {{(pid=129350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 06 10:38:25.327176 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.virt.hardware [None req-f9f4deb2-730d-45a7-ae6e-b72cf6a62099 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 06 10:38:25.370887 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-f9f4deb2-730d-45a7-ae6e-b72cf6a62099 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:38:25.371345 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-f9f4deb2-730d-45a7-ae6e-b72cf6a62099 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:38:25.383506 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-f9f4deb2-730d-45a7-ae6e-b72cf6a62099 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:38:25.384037 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-f9f4deb2-730d-45a7-ae6e-b72cf6a62099 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:38:25.464322 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.quota [None req-f9f4deb2-730d-45a7-ae6e-b72cf6a62099 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Getting quotas for project e2b17b61b73b4e6d81dd8ffe9cf311ea. Resources: {'ram', 'cores', 'instances'} {{(pid=129350) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 06 10:38:25.487931 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.quota [None req-f9f4deb2-730d-45a7-ae6e-b72cf6a62099 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Getting quotas for user f269e146c844480c822347c3a38d103b and project e2b17b61b73b4e6d81dd8ffe9cf311ea. Resources: {'ram', 'cores', 'instances'} {{(pid=129350) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 06 10:38:25.519291 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-f9f4deb2-730d-45a7-ae6e-b72cf6a62099 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Going to run 1 instances... {{(pid=129350) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 06 10:38:25.539767 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-f9f4deb2-730d-45a7-ae6e-b72cf6a62099 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] [instance: 6345448b-01b7-4429-bb10-fc5ae449ef71] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6eea2d98-354d-4083-b74c-abcbb97f9e1a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129350) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 06 10:38:25.679423 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-ec925ff8-cae7-419d-8b79-2d5dfcf73492 tempest-DeleteServersTestJSON-1512496307 tempest-DeleteServersTestJSON-1512496307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bbc3cd193444a65861f6e6705fd32cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8486d765afed40dc8795c7ba485d9535', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:38:25.694180 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-ec925ff8-cae7-419d-8b79-2d5dfcf73492 tempest-DeleteServersTestJSON-1512496307 tempest-DeleteServersTestJSON-1512496307-project] 10.222.0.42 "GET /compute/v2.1/servers/d0c59b89-6051-4967-81c6-1e9559a7d7b6" status: 200 len: 1315 microversion: 2.1 time: 0.643349 Jun 06 10:38:25.705859 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 28/39] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:38:25 2022] GET /compute/v2.1/servers/d0c59b89-6051-4967-81c6-1e9559a7d7b6 => generated 1315 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 10:38:25.726107 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-f9f4deb2-730d-45a7-ae6e-b72cf6a62099 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.062788 Jun 06 10:38:25.727405 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 12/40] 10.222.0.42 () {60 vars in 1146 bytes} [Mon Jun 6 10:38:21 2022] POST /compute/v2.1/servers => generated 383 bytes in 4065 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 06 10:38:25.738701 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-6d33cb47-6517-4751-bafd-9babc5a59d8e tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:38:25.739471 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-6d33cb47-6517-4751-bafd-9babc5a59d8e tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] [instance: 6345448b-01b7-4429-bb10-fc5ae449ef71] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:38:26.318604 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-6d33cb47-6517-4751-bafd-9babc5a59d8e tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f269e146c844480c822347c3a38d103b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2b17b61b73b4e6d81dd8ffe9cf311ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:38:26.337308 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-6d33cb47-6517-4751-bafd-9babc5a59d8e tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] 10.222.0.42 "GET /compute/v2.1/servers/6345448b-01b7-4429-bb10-fc5ae449ef71" status: 200 len: 1222 microversion: 2.1 time: 0.598898 Jun 06 10:38:26.339341 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 29/41] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:38:25 2022] GET /compute/v2.1/servers/6345448b-01b7-4429-bb10-fc5ae449ef71 => generated 1222 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:38:26.712536 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-5c57bc01-092b-474d-8f8b-1408ced8628e tempest-DeleteServersTestJSON-1512496307 tempest-DeleteServersTestJSON-1512496307-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:38:26.713461 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-5c57bc01-092b-474d-8f8b-1408ced8628e tempest-DeleteServersTestJSON-1512496307 tempest-DeleteServersTestJSON-1512496307-project] [instance: d0c59b89-6051-4967-81c6-1e9559a7d7b6] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:38:26.729773 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-5c57bc01-092b-474d-8f8b-1408ced8628e tempest-DeleteServersTestJSON-1512496307 tempest-DeleteServersTestJSON-1512496307-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:38:26.730704 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-5c57bc01-092b-474d-8f8b-1408ced8628e tempest-DeleteServersTestJSON-1512496307 tempest-DeleteServersTestJSON-1512496307-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:38:26.732442 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-5c57bc01-092b-474d-8f8b-1408ced8628e tempest-DeleteServersTestJSON-1512496307 tempest-DeleteServersTestJSON-1512496307-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:38:26.735408 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-5c57bc01-092b-474d-8f8b-1408ced8628e tempest-DeleteServersTestJSON-1512496307 tempest-DeleteServersTestJSON-1512496307-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:38:27.005910 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-77c0faac-c634-40e3-ba2a-95f6266bfcac tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Action: 'create', calling method: .version_select at 0x7f8fd855d4c0>, body: {"keypair": {"name": "tempest-keypair-195121733", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCfIwCF1jpMJh+YtxEtglD0i6r24ZvmLfdvxxmghPEXdsmC9iqV5EYo8WGu9jZ82NJH8FW833JTLTI+vMqXdBl8k8pdJ/JhNZSLTHoq4WHtbEnUbuqprqkzRG2HhZ+LANw=="}} {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 10:38:27.049467 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.quota [None req-77c0faac-c634-40e3-ba2a-95f6266bfcac tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Getting quotas for project 4905170c438f456182ba201316a64029. Resources: {'key_pairs'} {{(pid=129350) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 06 10:38:27.070545 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.quota [None req-77c0faac-c634-40e3-ba2a-95f6266bfcac tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Getting quotas for user ea1482ba53554f71865cea46ffbac23c and project 4905170c438f456182ba201316a64029. Resources: {'key_pairs'} {{(pid=129350) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 06 10:38:27.160383 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-77c0faac-c634-40e3-ba2a-95f6266bfcac tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 1.047622 Jun 06 10:38:27.162560 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 13/42] 10.222.0.42 () {62 vars in 1199 bytes} [Mon Jun 6 10:38:26 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 1051 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 06 10:38:27.368806 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-8c7c0f80-92e8-4cbb-ab02-3d20bf4f0b5c tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1863100370", "imageRef": "6eea2d98-354d-4083-b74c-abcbb97f9e1a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 10:38:27.496022 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.network.neutron [None req-8c7c0f80-92e8-4cbb-ab02-3d20bf4f0b5c tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] validate_networks() for [('da9f0b74-ba8e-4c64-8104-9e13c79c47b6', None, None, None, None, None)] {{(pid=129350) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 06 10:38:27.738158 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-5c57bc01-092b-474d-8f8b-1408ced8628e tempest-DeleteServersTestJSON-1512496307 tempest-DeleteServersTestJSON-1512496307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bbc3cd193444a65861f6e6705fd32cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8486d765afed40dc8795c7ba485d9535', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:38:27.762347 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-5c57bc01-092b-474d-8f8b-1408ced8628e tempest-DeleteServersTestJSON-1512496307 tempest-DeleteServersTestJSON-1512496307-project] 10.222.0.42 "GET /compute/v2.1/servers/d0c59b89-6051-4967-81c6-1e9559a7d7b6" status: 200 len: 1315 microversion: 2.1 time: 1.053628 Jun 06 10:38:27.777629 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 30/43] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:38:26 2022] GET /compute/v2.1/servers/d0c59b89-6051-4967-81c6-1e9559a7d7b6 => generated 1315 bytes in 1070 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 10:38:27.795585 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-a52de7aa-a15e-41ba-9040-07a23cadbc13 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-488630149", "imageRef": "6eea2d98-354d-4083-b74c-abcbb97f9e1a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "0fd14970-44c4-4b61-bc49-92cac8d7f904"}], "security_groups": [{"name": "tempest-securitygroup--1142281075"}], "key_name": "tempest-keypair-1188802404", "user_data": "}} {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 10:38:28.497910 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.network.neutron [None req-a52de7aa-a15e-41ba-9040-07a23cadbc13 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] validate_networks() for [('0fd14970-44c4-4b61-bc49-92cac8d7f904', None, None, None, None, None)] {{(pid=129349) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 06 10:38:28.986243 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.virt.hardware [None req-8c7c0f80-92e8-4cbb-ab02-3d20bf4f0b5c tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Flavor limits 0:0:0 {{(pid=129350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 06 10:38:28.986772 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.virt.hardware [None req-8c7c0f80-92e8-4cbb-ab02-3d20bf4f0b5c tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Image limits 0:0:0 {{(pid=129350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 06 10:38:28.987241 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.virt.hardware [None req-8c7c0f80-92e8-4cbb-ab02-3d20bf4f0b5c tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Flavor pref 0:0:0 {{(pid=129350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 06 10:38:28.987754 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.virt.hardware [None req-8c7c0f80-92e8-4cbb-ab02-3d20bf4f0b5c tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Image pref 0:0:0 {{(pid=129350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 06 10:38:28.988395 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.virt.hardware [None req-8c7c0f80-92e8-4cbb-ab02-3d20bf4f0b5c tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 06 10:38:29.012729 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-8c7c0f80-92e8-4cbb-ab02-3d20bf4f0b5c tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:38:29.013340 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-8c7c0f80-92e8-4cbb-ab02-3d20bf4f0b5c tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:38:29.017559 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-8c7c0f80-92e8-4cbb-ab02-3d20bf4f0b5c tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:38:29.019246 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-8c7c0f80-92e8-4cbb-ab02-3d20bf4f0b5c tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:38:29.064248 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.quota [None req-8c7c0f80-92e8-4cbb-ab02-3d20bf4f0b5c tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Getting quotas for project e2b17b61b73b4e6d81dd8ffe9cf311ea. Resources: {'ram', 'cores', 'instances'} {{(pid=129350) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 06 10:38:29.069815 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.quota [None req-8c7c0f80-92e8-4cbb-ab02-3d20bf4f0b5c tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Getting quotas for user f269e146c844480c822347c3a38d103b and project e2b17b61b73b4e6d81dd8ffe9cf311ea. Resources: {'ram', 'cores', 'instances'} {{(pid=129350) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 06 10:38:29.083425 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-8c7c0f80-92e8-4cbb-ab02-3d20bf4f0b5c tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Going to run 1 instances... {{(pid=129350) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 06 10:38:29.086034 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-8c7c0f80-92e8-4cbb-ab02-3d20bf4f0b5c tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] [instance: 3bdaf03c-d0a2-4d6c-b0f1-ec2d580e63ef] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6eea2d98-354d-4083-b74c-abcbb97f9e1a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129350) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 06 10:38:29.214286 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-8c7c0f80-92e8-4cbb-ab02-3d20bf4f0b5c tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.852205 Jun 06 10:38:29.215530 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 14/44] 10.222.0.42 () {60 vars in 1146 bytes} [Mon Jun 6 10:38:27 2022] POST /compute/v2.1/servers => generated 383 bytes in 1854 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 06 10:38:29.221033 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-e70a74bc-b7d8-4a51-a815-d630577685a4 tempest-DeleteServersTestJSON-1512496307 tempest-DeleteServersTestJSON-1512496307-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:38:29.222986 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-e70a74bc-b7d8-4a51-a815-d630577685a4 tempest-DeleteServersTestJSON-1512496307 tempest-DeleteServersTestJSON-1512496307-project] [instance: d0c59b89-6051-4967-81c6-1e9559a7d7b6] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:38:29.230899 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-e70a74bc-b7d8-4a51-a815-d630577685a4 tempest-DeleteServersTestJSON-1512496307 tempest-DeleteServersTestJSON-1512496307-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:38:29.231625 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-e70a74bc-b7d8-4a51-a815-d630577685a4 tempest-DeleteServersTestJSON-1512496307 tempest-DeleteServersTestJSON-1512496307-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:38:29.233744 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-e70a74bc-b7d8-4a51-a815-d630577685a4 tempest-DeleteServersTestJSON-1512496307 tempest-DeleteServersTestJSON-1512496307-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:38:29.234680 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-e70a74bc-b7d8-4a51-a815-d630577685a4 tempest-DeleteServersTestJSON-1512496307 tempest-DeleteServersTestJSON-1512496307-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:38:29.610971 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-e70a74bc-b7d8-4a51-a815-d630577685a4 tempest-DeleteServersTestJSON-1512496307 tempest-DeleteServersTestJSON-1512496307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bbc3cd193444a65861f6e6705fd32cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8486d765afed40dc8795c7ba485d9535', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:38:29.629468 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-e70a74bc-b7d8-4a51-a815-d630577685a4 tempest-DeleteServersTestJSON-1512496307 tempest-DeleteServersTestJSON-1512496307-project] 10.222.0.42 "GET /compute/v2.1/servers/d0c59b89-6051-4967-81c6-1e9559a7d7b6" status: 200 len: 1315 microversion: 2.1 time: 0.412492 Jun 06 10:38:29.631192 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 15/45] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:38:29 2022] GET /compute/v2.1/servers/d0c59b89-6051-4967-81c6-1e9559a7d7b6 => generated 1315 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:38:29.645027 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-3b06c632-01b0-4a34-b5b5-aae91fe87a6b tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:38:29.651910 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-3b06c632-01b0-4a34-b5b5-aae91fe87a6b tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] [instance: 3bdaf03c-d0a2-4d6c-b0f1-ec2d580e63ef] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:38:29.751860 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-3b06c632-01b0-4a34-b5b5-aae91fe87a6b tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f269e146c844480c822347c3a38d103b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2b17b61b73b4e6d81dd8ffe9cf311ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:38:29.798471 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-3b06c632-01b0-4a34-b5b5-aae91fe87a6b tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] 10.222.0.42 "GET /compute/v2.1/servers/3bdaf03c-d0a2-4d6c-b0f1-ec2d580e63ef" status: 200 len: 1222 microversion: 2.1 time: 0.162624 Jun 06 10:38:29.813719 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 16/46] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:38:29 2022] GET /compute/v2.1/servers/3bdaf03c-d0a2-4d6c-b0f1-ec2d580e63ef => generated 1222 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:38:30.426311 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-9d7ca462-8ce8-42df-8838-387fdc795358 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1263081983", "imageRef": "6eea2d98-354d-4083-b74c-abcbb97f9e1a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "0be38b0d-7530-4917-a019-0b1399ba4500"}], "security_groups": [{"name": "tempest-securitygroup--762727028"}], "key_name": "tempest-keypair-195121733", "user_data": "}} {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 10:38:30.948059 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.network.neutron [None req-9d7ca462-8ce8-42df-8838-387fdc795358 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] validate_networks() for [('0be38b0d-7530-4917-a019-0b1399ba4500', None, None, None, None, None)] {{(pid=129350) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 06 10:38:31.942062 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.virt.hardware [None req-a52de7aa-a15e-41ba-9040-07a23cadbc13 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Flavor limits 0:0:0 {{(pid=129349) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 06 10:38:31.943033 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.virt.hardware [None req-a52de7aa-a15e-41ba-9040-07a23cadbc13 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Image limits 0:0:0 {{(pid=129349) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 06 10:38:31.943958 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.virt.hardware [None req-a52de7aa-a15e-41ba-9040-07a23cadbc13 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Flavor pref 0:0:0 {{(pid=129349) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 06 10:38:31.944696 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.virt.hardware [None req-a52de7aa-a15e-41ba-9040-07a23cadbc13 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Image pref 0:0:0 {{(pid=129349) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 06 10:38:31.945116 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.virt.hardware [None req-a52de7aa-a15e-41ba-9040-07a23cadbc13 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129349) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 06 10:38:31.947692 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG dbcounter [-] [129349] Writing DB stats nova_api:SELECT=29 {{(pid=129349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 10:38:31.996728 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-a52de7aa-a15e-41ba-9040-07a23cadbc13 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:38:31.999818 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-a52de7aa-a15e-41ba-9040-07a23cadbc13 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:38:32.000765 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-a52de7aa-a15e-41ba-9040-07a23cadbc13 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:38:32.001212 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-a52de7aa-a15e-41ba-9040-07a23cadbc13 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:38:32.088098 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.quota [None req-a52de7aa-a15e-41ba-9040-07a23cadbc13 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Getting quotas for project fe30c756a2f84166ad23af1edf83157e. Resources: {'ram', 'cores', 'instances'} {{(pid=129349) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 06 10:38:32.122597 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.quota [None req-a52de7aa-a15e-41ba-9040-07a23cadbc13 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Getting quotas for user f6b7d82c999646b6b6b96d565f0e3f9a and project fe30c756a2f84166ad23af1edf83157e. Resources: {'ram', 'cores', 'instances'} {{(pid=129349) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 06 10:38:32.164600 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-a52de7aa-a15e-41ba-9040-07a23cadbc13 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Going to run 1 instances... {{(pid=129349) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 06 10:38:32.176586 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-a52de7aa-a15e-41ba-9040-07a23cadbc13 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] [instance: f49079c1-1384-4136-b6cf-eadc40fb5aa1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6eea2d98-354d-4083-b74c-abcbb97f9e1a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129349) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 06 10:38:32.359420 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-a52de7aa-a15e-41ba-9040-07a23cadbc13 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 4.577728 Jun 06 10:38:32.360397 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 31/47] 10.222.0.42 () {60 vars in 1146 bytes} [Mon Jun 6 10:38:27 2022] POST /compute/v2.1/servers => generated 402 bytes in 4582 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 06 10:38:32.380346 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-a483ab95-7e0c-46d8-b4dd-6c61aee3218d tempest-DeleteServersTestJSON-1512496307 tempest-DeleteServersTestJSON-1512496307-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:38:32.382379 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-a483ab95-7e0c-46d8-b4dd-6c61aee3218d tempest-DeleteServersTestJSON-1512496307 tempest-DeleteServersTestJSON-1512496307-project] [instance: d0c59b89-6051-4967-81c6-1e9559a7d7b6] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:38:32.418610 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-a483ab95-7e0c-46d8-b4dd-6c61aee3218d tempest-DeleteServersTestJSON-1512496307 tempest-DeleteServersTestJSON-1512496307-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:38:32.420947 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-a483ab95-7e0c-46d8-b4dd-6c61aee3218d tempest-DeleteServersTestJSON-1512496307 tempest-DeleteServersTestJSON-1512496307-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:38:32.430205 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-a483ab95-7e0c-46d8-b4dd-6c61aee3218d tempest-DeleteServersTestJSON-1512496307 tempest-DeleteServersTestJSON-1512496307-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:38:32.431149 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-a483ab95-7e0c-46d8-b4dd-6c61aee3218d tempest-DeleteServersTestJSON-1512496307 tempest-DeleteServersTestJSON-1512496307-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:38:32.977823 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.virt.hardware [None req-9d7ca462-8ce8-42df-8838-387fdc795358 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Flavor limits 0:0:0 {{(pid=129350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 06 10:38:32.978448 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.virt.hardware [None req-9d7ca462-8ce8-42df-8838-387fdc795358 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Image limits 0:0:0 {{(pid=129350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 06 10:38:32.978749 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.virt.hardware [None req-9d7ca462-8ce8-42df-8838-387fdc795358 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Flavor pref 0:0:0 {{(pid=129350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 06 10:38:32.979190 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.virt.hardware [None req-9d7ca462-8ce8-42df-8838-387fdc795358 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Image pref 0:0:0 {{(pid=129350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 06 10:38:32.979738 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.virt.hardware [None req-9d7ca462-8ce8-42df-8838-387fdc795358 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 06 10:38:32.999627 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-9d7ca462-8ce8-42df-8838-387fdc795358 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:38:33.006472 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-9d7ca462-8ce8-42df-8838-387fdc795358 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:38:33.007467 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-9d7ca462-8ce8-42df-8838-387fdc795358 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:38:33.007971 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-9d7ca462-8ce8-42df-8838-387fdc795358 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:38:33.051160 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.quota [None req-9d7ca462-8ce8-42df-8838-387fdc795358 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Getting quotas for project 4905170c438f456182ba201316a64029. Resources: {'ram', 'cores', 'instances'} {{(pid=129350) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 06 10:38:33.064405 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.quota [None req-9d7ca462-8ce8-42df-8838-387fdc795358 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Getting quotas for user ea1482ba53554f71865cea46ffbac23c and project 4905170c438f456182ba201316a64029. Resources: {'ram', 'cores', 'instances'} {{(pid=129350) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 06 10:38:33.080879 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG dbcounter [-] [129350] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=11 {{(pid=129350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 10:38:33.086752 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-9d7ca462-8ce8-42df-8838-387fdc795358 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Going to run 1 instances... {{(pid=129350) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 06 10:38:33.090722 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-9d7ca462-8ce8-42df-8838-387fdc795358 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] [instance: 5a0a79a6-8e61-477e-8269-730dfb6d04a6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6eea2d98-354d-4083-b74c-abcbb97f9e1a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129350) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 06 10:38:33.205452 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-9d7ca462-8ce8-42df-8838-387fdc795358 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 2.790306 Jun 06 10:38:33.206995 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 17/48] 10.222.0.42 () {62 vars in 1187 bytes} [Mon Jun 6 10:38:30 2022] POST /compute/v2.1/servers => generated 401 bytes in 2795 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 06 10:38:33.212290 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-9bd531c8-5cbe-454e-9a18-4745da05ea9c tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:38:33.224701 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-9bd531c8-5cbe-454e-9a18-4745da05ea9c tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] [instance: 3bdaf03c-d0a2-4d6c-b0f1-ec2d580e63ef] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:38:33.241181 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-9bd531c8-5cbe-454e-9a18-4745da05ea9c tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:38:33.243856 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-9bd531c8-5cbe-454e-9a18-4745da05ea9c tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:38:33.244693 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-9bd531c8-5cbe-454e-9a18-4745da05ea9c tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:38:33.245567 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-9bd531c8-5cbe-454e-9a18-4745da05ea9c tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:38:33.300308 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-a483ab95-7e0c-46d8-b4dd-6c61aee3218d tempest-DeleteServersTestJSON-1512496307 tempest-DeleteServersTestJSON-1512496307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bbc3cd193444a65861f6e6705fd32cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8486d765afed40dc8795c7ba485d9535', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:38:33.313776 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-a483ab95-7e0c-46d8-b4dd-6c61aee3218d tempest-DeleteServersTestJSON-1512496307 tempest-DeleteServersTestJSON-1512496307-project] 10.222.0.42 "GET /compute/v2.1/servers/d0c59b89-6051-4967-81c6-1e9559a7d7b6" status: 200 len: 1315 microversion: 2.1 time: 0.952028 Jun 06 10:38:33.327049 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 32/49] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:38:32 2022] GET /compute/v2.1/servers/d0c59b89-6051-4967-81c6-1e9559a7d7b6 => generated 1315 bytes in 963 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:38:33.344110 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-0e2f0095-f520-46f5-b5e9-0c473a8dead8 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:38:33.344823 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-0e2f0095-f520-46f5-b5e9-0c473a8dead8 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] [instance: f49079c1-1384-4136-b6cf-eadc40fb5aa1] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:38:33.506632 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-9bd531c8-5cbe-454e-9a18-4745da05ea9c tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f269e146c844480c822347c3a38d103b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2b17b61b73b4e6d81dd8ffe9cf311ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:38:33.520884 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-9bd531c8-5cbe-454e-9a18-4745da05ea9c tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] 10.222.0.42 "GET /compute/v2.1/servers/3bdaf03c-d0a2-4d6c-b0f1-ec2d580e63ef" status: 200 len: 1280 microversion: 2.1 time: 0.309455 Jun 06 10:38:33.521532 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 18/50] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:38:33 2022] GET /compute/v2.1/servers/3bdaf03c-d0a2-4d6c-b0f1-ec2d580e63ef => generated 1280 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:38:33.544405 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-238fbb61-0b8b-4c3e-9195-9b2a7450f63f tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:38:33.545108 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-238fbb61-0b8b-4c3e-9195-9b2a7450f63f tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] [instance: 5a0a79a6-8e61-477e-8269-730dfb6d04a6] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:38:33.739886 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-0e2f0095-f520-46f5-b5e9-0c473a8dead8 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b7d82c999646b6b6b96d565f0e3f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe30c756a2f84166ad23af1edf83157e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:38:33.754474 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-0e2f0095-f520-46f5-b5e9-0c473a8dead8 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] 10.222.0.42 "GET /compute/v2.1/servers/f49079c1-1384-4136-b6cf-eadc40fb5aa1" status: 200 len: 1237 microversion: 2.1 time: 0.426080 Jun 06 10:38:33.757078 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 33/51] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:38:33 2022] GET /compute/v2.1/servers/f49079c1-1384-4136-b6cf-eadc40fb5aa1 => generated 1237 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:38:33.777831 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-238fbb61-0b8b-4c3e-9195-9b2a7450f63f tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:38:33.788601 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-238fbb61-0b8b-4c3e-9195-9b2a7450f63f tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:38:33.798838 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-238fbb61-0b8b-4c3e-9195-9b2a7450f63f tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:38:33.805444 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-238fbb61-0b8b-4c3e-9195-9b2a7450f63f tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0a79a6-8e61-477e-8269-730dfb6d04a6" status: 200 len: 1281 microversion: 2.20 time: 0.276213 Jun 06 10:38:33.806845 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 19/52] 10.222.0.42 () {60 vars in 1276 bytes} [Mon Jun 6 10:38:33 2022] GET /compute/v2.1/servers/5a0a79a6-8e61-477e-8269-730dfb6d04a6 => generated 1281 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 10:38:34.332981 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-0621db9c-8d21-43df-a277-5f183c8cb22c tempest-DeleteServersTestJSON-1512496307 tempest-DeleteServersTestJSON-1512496307-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:38:34.334230 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-0621db9c-8d21-43df-a277-5f183c8cb22c tempest-DeleteServersTestJSON-1512496307 tempest-DeleteServersTestJSON-1512496307-project] [instance: d0c59b89-6051-4967-81c6-1e9559a7d7b6] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:38:34.345062 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-0621db9c-8d21-43df-a277-5f183c8cb22c tempest-DeleteServersTestJSON-1512496307 tempest-DeleteServersTestJSON-1512496307-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:38:34.347350 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-0621db9c-8d21-43df-a277-5f183c8cb22c tempest-DeleteServersTestJSON-1512496307 tempest-DeleteServersTestJSON-1512496307-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:38:34.353864 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-0621db9c-8d21-43df-a277-5f183c8cb22c tempest-DeleteServersTestJSON-1512496307 tempest-DeleteServersTestJSON-1512496307-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:38:34.354626 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-0621db9c-8d21-43df-a277-5f183c8cb22c tempest-DeleteServersTestJSON-1512496307 tempest-DeleteServersTestJSON-1512496307-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:38:34.541096 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-203cc43b-a7cb-4193-8849-c5fa2d4a9b9c tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:38:34.543656 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-203cc43b-a7cb-4193-8849-c5fa2d4a9b9c tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] [instance: 3bdaf03c-d0a2-4d6c-b0f1-ec2d580e63ef] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:38:34.563129 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-203cc43b-a7cb-4193-8849-c5fa2d4a9b9c tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:38:34.563692 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-203cc43b-a7cb-4193-8849-c5fa2d4a9b9c tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:38:34.564626 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-203cc43b-a7cb-4193-8849-c5fa2d4a9b9c tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:38:34.565624 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-203cc43b-a7cb-4193-8849-c5fa2d4a9b9c tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:38:34.624003 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG dbcounter [-] [129350] Writing DB stats nova_cell1:SELECT=45 {{(pid=129350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 10:38:35.133186 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-203cc43b-a7cb-4193-8849-c5fa2d4a9b9c tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f269e146c844480c822347c3a38d103b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2b17b61b73b4e6d81dd8ffe9cf311ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:38:35.145979 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-203cc43b-a7cb-4193-8849-c5fa2d4a9b9c tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] 10.222.0.42 "GET /compute/v2.1/servers/3bdaf03c-d0a2-4d6c-b0f1-ec2d580e63ef" status: 200 len: 1322 microversion: 2.1 time: 0.609730 Jun 06 10:38:35.146883 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 20/53] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:38:34 2022] GET /compute/v2.1/servers/3bdaf03c-d0a2-4d6c-b0f1-ec2d580e63ef => generated 1322 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:38:35.161972 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-17eb56fe-15e3-4987-8cb0-51a9c2c96beb tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:38:35.162132 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-0621db9c-8d21-43df-a277-5f183c8cb22c tempest-DeleteServersTestJSON-1512496307 tempest-DeleteServersTestJSON-1512496307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bbc3cd193444a65861f6e6705fd32cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8486d765afed40dc8795c7ba485d9535', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:38:35.164002 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-17eb56fe-15e3-4987-8cb0-51a9c2c96beb tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] [instance: f49079c1-1384-4136-b6cf-eadc40fb5aa1] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:38:35.177784 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-0621db9c-8d21-43df-a277-5f183c8cb22c tempest-DeleteServersTestJSON-1512496307 tempest-DeleteServersTestJSON-1512496307-project] 10.222.0.42 "GET /compute/v2.1/servers/d0c59b89-6051-4967-81c6-1e9559a7d7b6" status: 200 len: 1315 microversion: 2.1 time: 0.849257 Jun 06 10:38:35.180079 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-17eb56fe-15e3-4987-8cb0-51a9c2c96beb tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:38:35.181832 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 34/54] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:38:34 2022] GET /compute/v2.1/servers/d0c59b89-6051-4967-81c6-1e9559a7d7b6 => generated 1315 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:38:35.182275 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-17eb56fe-15e3-4987-8cb0-51a9c2c96beb tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:38:35.183406 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-17eb56fe-15e3-4987-8cb0-51a9c2c96beb tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:38:35.184971 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-17eb56fe-15e3-4987-8cb0-51a9c2c96beb tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:38:35.194104 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-91ab7fef-3cb7-45cd-9a34-9278e69ae1c7 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:38:35.195571 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-91ab7fef-3cb7-45cd-9a34-9278e69ae1c7 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] [instance: 5a0a79a6-8e61-477e-8269-730dfb6d04a6] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:38:35.209328 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-91ab7fef-3cb7-45cd-9a34-9278e69ae1c7 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:38:35.212180 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-91ab7fef-3cb7-45cd-9a34-9278e69ae1c7 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:38:35.214830 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-91ab7fef-3cb7-45cd-9a34-9278e69ae1c7 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:38:35.215443 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-91ab7fef-3cb7-45cd-9a34-9278e69ae1c7 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:38:35.443578 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-17eb56fe-15e3-4987-8cb0-51a9c2c96beb tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b7d82c999646b6b6b96d565f0e3f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe30c756a2f84166ad23af1edf83157e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:38:35.454752 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-17eb56fe-15e3-4987-8cb0-51a9c2c96beb tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] 10.222.0.42 "GET /compute/v2.1/servers/f49079c1-1384-4136-b6cf-eadc40fb5aa1" status: 200 len: 1295 microversion: 2.1 time: 0.306486 Jun 06 10:38:35.457761 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 21/55] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:38:35 2022] GET /compute/v2.1/servers/f49079c1-1384-4136-b6cf-eadc40fb5aa1 => generated 1295 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:38:35.497882 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-91ab7fef-3cb7-45cd-9a34-9278e69ae1c7 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:38:35.518243 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-91ab7fef-3cb7-45cd-9a34-9278e69ae1c7 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:38:35.533617 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-91ab7fef-3cb7-45cd-9a34-9278e69ae1c7 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:38:35.536378 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-91ab7fef-3cb7-45cd-9a34-9278e69ae1c7 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0a79a6-8e61-477e-8269-730dfb6d04a6" status: 200 len: 1341 microversion: 2.20 time: 0.352465 Jun 06 10:38:35.539501 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 35/56] 10.222.0.42 () {60 vars in 1276 bytes} [Mon Jun 6 10:38:35 2022] GET /compute/v2.1/servers/5a0a79a6-8e61-477e-8269-730dfb6d04a6 => generated 1341 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 10:38:35.821111 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [req-27a89f41-14d6-4ffa-a501-4bf259bdc7d6 req-d5c4e47f-dd88-4c8e-ae7d-b674aea471b3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6345448b-01b7-4429-bb10-fc5ae449ef71", "tag": "78530f9c-98da-46f9-99ec-e1825fb9f8d3"}]} {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 10:38:35.865725 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [req-27a89f41-14d6-4ffa-a501-4bf259bdc7d6 req-d5c4e47f-dd88-4c8e-ae7d-b674aea471b3 service nova] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:38:35.866550 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [req-27a89f41-14d6-4ffa-a501-4bf259bdc7d6 req-d5c4e47f-dd88-4c8e-ae7d-b674aea471b3 service nova] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:38:35.972321 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.compute.server_external_events [req-27a89f41-14d6-4ffa-a501-4bf259bdc7d6 req-d5c4e47f-dd88-4c8e-ae7d-b674aea471b3 service nova] Creating event network-changed:78530f9c-98da-46f9-99ec-e1825fb9f8d3 for instance 6345448b-01b7-4429-bb10-fc5ae449ef71 on hv-cinder-84482 Jun 06 10:38:35.976668 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [req-27a89f41-14d6-4ffa-a501-4bf259bdc7d6 req-d5c4e47f-dd88-4c8e-ae7d-b674aea471b3 service nova] Acquired lock "compute-rpcapi-router" {{(pid=129350) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 06 10:38:35.981424 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-4bf7a736-7ff6-4079-baf4-321615760516 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:38:35.982183 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-4bf7a736-7ff6-4079-baf4-321615760516 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:38:35.985678 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-4bf7a736-7ff6-4079-baf4-321615760516 None None] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:38:35.987307 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-4bf7a736-7ff6-4079-baf4-321615760516 None None] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:38:36.055347 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.compute.rpcapi [None req-4bf7a736-7ff6-4079-baf4-321615760516 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 06 10:38:36.056292 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-4bf7a736-7ff6-4079-baf4-321615760516 None None] Releasing lock "compute-rpcapi-router" {{(pid=129350) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 06 10:38:36.106203 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-4bf7a736-7ff6-4079-baf4-321615760516 None None] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.291519 Jun 06 10:38:36.106973 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 22/57] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Jun 6 10:38:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 10:38:36.166929 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-ea6f1d86-399b-40d4-a506-a27e8af685e5 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:38:36.167640 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-ea6f1d86-399b-40d4-a506-a27e8af685e5 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] [instance: 3bdaf03c-d0a2-4d6c-b0f1-ec2d580e63ef] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:38:36.175041 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-ea6f1d86-399b-40d4-a506-a27e8af685e5 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:38:36.175428 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-ea6f1d86-399b-40d4-a506-a27e8af685e5 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:38:36.176220 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-ea6f1d86-399b-40d4-a506-a27e8af685e5 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:38:36.176651 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-ea6f1d86-399b-40d4-a506-a27e8af685e5 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:38:36.208474 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [req-5b08636e-52ca-4ba7-80ad-9de8f47d3481 req-031b684f-4ad2-4a99-9ad8-7adc8eedd0e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0c59b89-6051-4967-81c6-1e9559a7d7b6", "name": "network-vif-plugged", "status": "completed", "tag": "111884d2-003e-4adc-825c-d66d4bfa0c32"}]} {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 10:38:36.227652 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [req-5b08636e-52ca-4ba7-80ad-9de8f47d3481 req-031b684f-4ad2-4a99-9ad8-7adc8eedd0e3 service nova] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:38:36.232318 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [req-5b08636e-52ca-4ba7-80ad-9de8f47d3481 req-031b684f-4ad2-4a99-9ad8-7adc8eedd0e3 service nova] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:38:36.261243 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.compute.server_external_events [req-5b08636e-52ca-4ba7-80ad-9de8f47d3481 req-031b684f-4ad2-4a99-9ad8-7adc8eedd0e3 service nova] Creating event network-vif-plugged:111884d2-003e-4adc-825c-d66d4bfa0c32 for instance d0c59b89-6051-4967-81c6-1e9559a7d7b6 on hv-cinder-84482 Jun 06 10:38:36.276088 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [req-5b08636e-52ca-4ba7-80ad-9de8f47d3481 req-031b684f-4ad2-4a99-9ad8-7adc8eedd0e3 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.141091 Jun 06 10:38:36.277280 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 36/58] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Jun 6 10:38:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 10:38:36.288331 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-8b8038db-6776-436f-a2be-102b44d3cb8b tempest-DeleteServersTestJSON-1512496307 tempest-DeleteServersTestJSON-1512496307-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:38:36.293359 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-8b8038db-6776-436f-a2be-102b44d3cb8b tempest-DeleteServersTestJSON-1512496307 tempest-DeleteServersTestJSON-1512496307-project] [instance: d0c59b89-6051-4967-81c6-1e9559a7d7b6] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:38:36.314364 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-8b8038db-6776-436f-a2be-102b44d3cb8b tempest-DeleteServersTestJSON-1512496307 tempest-DeleteServersTestJSON-1512496307-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:38:36.318545 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-8b8038db-6776-436f-a2be-102b44d3cb8b tempest-DeleteServersTestJSON-1512496307 tempest-DeleteServersTestJSON-1512496307-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:38:36.321606 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-8b8038db-6776-436f-a2be-102b44d3cb8b tempest-DeleteServersTestJSON-1512496307 tempest-DeleteServersTestJSON-1512496307-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:38:36.328627 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-8b8038db-6776-436f-a2be-102b44d3cb8b tempest-DeleteServersTestJSON-1512496307 tempest-DeleteServersTestJSON-1512496307-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:38:37.312630 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-8b8038db-6776-436f-a2be-102b44d3cb8b tempest-DeleteServersTestJSON-1512496307 tempest-DeleteServersTestJSON-1512496307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bbc3cd193444a65861f6e6705fd32cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8486d765afed40dc8795c7ba485d9535', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:38:37.321503 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-ea6f1d86-399b-40d4-a506-a27e8af685e5 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f269e146c844480c822347c3a38d103b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2b17b61b73b4e6d81dd8ffe9cf311ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:38:37.328842 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-8b8038db-6776-436f-a2be-102b44d3cb8b tempest-DeleteServersTestJSON-1512496307 tempest-DeleteServersTestJSON-1512496307-project] 10.222.0.42 "GET /compute/v2.1/servers/d0c59b89-6051-4967-81c6-1e9559a7d7b6" status: 200 len: 1315 microversion: 2.1 time: 1.050155 Jun 06 10:38:37.332358 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 37/59] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:38:36 2022] GET /compute/v2.1/servers/d0c59b89-6051-4967-81c6-1e9559a7d7b6 => generated 1315 bytes in 1054 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:38:37.345384 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-4d053fec-c14c-47eb-a63c-b05ed7cd8f9a tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:38:37.346983 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-4d053fec-c14c-47eb-a63c-b05ed7cd8f9a tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] [instance: f49079c1-1384-4136-b6cf-eadc40fb5aa1] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:38:37.351766 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-ea6f1d86-399b-40d4-a506-a27e8af685e5 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] 10.222.0.42 "GET /compute/v2.1/servers/3bdaf03c-d0a2-4d6c-b0f1-ec2d580e63ef" status: 200 len: 1322 microversion: 2.1 time: 1.188907 Jun 06 10:38:37.356598 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 23/60] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:38:36 2022] GET /compute/v2.1/servers/3bdaf03c-d0a2-4d6c-b0f1-ec2d580e63ef => generated 1322 bytes in 1194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 10:38:37.360727 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-4d053fec-c14c-47eb-a63c-b05ed7cd8f9a tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:38:37.366254 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-f2244bab-42cb-47b3-a709-ddad0bb48a4e tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:38:37.366254 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-f2244bab-42cb-47b3-a709-ddad0bb48a4e tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] [instance: 5a0a79a6-8e61-477e-8269-730dfb6d04a6] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:38:37.370378 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-4d053fec-c14c-47eb-a63c-b05ed7cd8f9a tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:38:37.371534 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-4d053fec-c14c-47eb-a63c-b05ed7cd8f9a tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:38:37.375147 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-4d053fec-c14c-47eb-a63c-b05ed7cd8f9a tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:38:37.396361 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-f2244bab-42cb-47b3-a709-ddad0bb48a4e tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:38:37.396811 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-f2244bab-42cb-47b3-a709-ddad0bb48a4e tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:38:37.397585 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-f2244bab-42cb-47b3-a709-ddad0bb48a4e tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:38:37.398019 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-f2244bab-42cb-47b3-a709-ddad0bb48a4e tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:38:37.625641 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-4d053fec-c14c-47eb-a63c-b05ed7cd8f9a tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b7d82c999646b6b6b96d565f0e3f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe30c756a2f84166ad23af1edf83157e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:38:37.633143 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-4d053fec-c14c-47eb-a63c-b05ed7cd8f9a tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] 10.222.0.42 "GET /compute/v2.1/servers/f49079c1-1384-4136-b6cf-eadc40fb5aa1" status: 200 len: 1295 microversion: 2.1 time: 0.298807 Jun 06 10:38:37.633708 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 38/61] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:38:37 2022] GET /compute/v2.1/servers/f49079c1-1384-4136-b6cf-eadc40fb5aa1 => generated 1295 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:38:37.642204 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-f2244bab-42cb-47b3-a709-ddad0bb48a4e tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:38:37.653136 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-f2244bab-42cb-47b3-a709-ddad0bb48a4e tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:38:37.655713 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-f2244bab-42cb-47b3-a709-ddad0bb48a4e tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:38:37.657115 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-f2244bab-42cb-47b3-a709-ddad0bb48a4e tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0a79a6-8e61-477e-8269-730dfb6d04a6" status: 200 len: 1339 microversion: 2.20 time: 0.298700 Jun 06 10:38:37.658322 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 24/62] 10.222.0.42 () {60 vars in 1276 bytes} [Mon Jun 6 10:38:37 2022] GET /compute/v2.1/servers/5a0a79a6-8e61-477e-8269-730dfb6d04a6 => generated 1339 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 10:38:37.715593 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [req-ea2f215b-d36a-494f-9bc8-de57f51854a2 req-087b1bc0-59d2-4c52-a8ec-0ddc59f03a9e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3bdaf03c-d0a2-4d6c-b0f1-ec2d580e63ef", "tag": "d62ce760-3526-43c3-ad0f-43053dbe7424"}]} {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 10:38:37.723855 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [req-ea2f215b-d36a-494f-9bc8-de57f51854a2 req-087b1bc0-59d2-4c52-a8ec-0ddc59f03a9e service nova] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:38:37.724333 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [req-ea2f215b-d36a-494f-9bc8-de57f51854a2 req-087b1bc0-59d2-4c52-a8ec-0ddc59f03a9e service nova] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:38:37.736340 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.compute.server_external_events [req-ea2f215b-d36a-494f-9bc8-de57f51854a2 req-087b1bc0-59d2-4c52-a8ec-0ddc59f03a9e service nova] Creating event network-changed:d62ce760-3526-43c3-ad0f-43053dbe7424 for instance 3bdaf03c-d0a2-4d6c-b0f1-ec2d580e63ef on hv-cinder-84482 Jun 06 10:38:37.741565 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [req-ea2f215b-d36a-494f-9bc8-de57f51854a2 req-087b1bc0-59d2-4c52-a8ec-0ddc59f03a9e service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106503 Jun 06 10:38:37.744101 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 39/63] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Jun 6 10:38:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 10:38:38.361853 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-b541b046-de5a-495d-96ce-efba034766fd tempest-DeleteServersTestJSON-1512496307 tempest-DeleteServersTestJSON-1512496307-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:38:38.363232 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-b541b046-de5a-495d-96ce-efba034766fd tempest-DeleteServersTestJSON-1512496307 tempest-DeleteServersTestJSON-1512496307-project] [instance: d0c59b89-6051-4967-81c6-1e9559a7d7b6] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:38:38.371269 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-b541b046-de5a-495d-96ce-efba034766fd tempest-DeleteServersTestJSON-1512496307 tempest-DeleteServersTestJSON-1512496307-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:38:38.372132 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-b541b046-de5a-495d-96ce-efba034766fd tempest-DeleteServersTestJSON-1512496307 tempest-DeleteServersTestJSON-1512496307-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:38:38.373989 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-acff4fed-1ebb-4bc2-9fb1-cf82d6e7db5d tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:38:38.374759 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-acff4fed-1ebb-4bc2-9fb1-cf82d6e7db5d tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] [instance: 3bdaf03c-d0a2-4d6c-b0f1-ec2d580e63ef] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:38:38.375523 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-b541b046-de5a-495d-96ce-efba034766fd tempest-DeleteServersTestJSON-1512496307 tempest-DeleteServersTestJSON-1512496307-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:38:38.377139 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-b541b046-de5a-495d-96ce-efba034766fd tempest-DeleteServersTestJSON-1512496307 tempest-DeleteServersTestJSON-1512496307-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:38:38.383285 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-acff4fed-1ebb-4bc2-9fb1-cf82d6e7db5d tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:38:38.384544 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-acff4fed-1ebb-4bc2-9fb1-cf82d6e7db5d tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:38:38.385818 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-acff4fed-1ebb-4bc2-9fb1-cf82d6e7db5d tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:38:38.385918 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-acff4fed-1ebb-4bc2-9fb1-cf82d6e7db5d tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:38:38.645258 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-b541b046-de5a-495d-96ce-efba034766fd tempest-DeleteServersTestJSON-1512496307 tempest-DeleteServersTestJSON-1512496307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bbc3cd193444a65861f6e6705fd32cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8486d765afed40dc8795c7ba485d9535', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:38:38.653459 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-b541b046-de5a-495d-96ce-efba034766fd tempest-DeleteServersTestJSON-1512496307 tempest-DeleteServersTestJSON-1512496307-project] 10.222.0.42 "GET /compute/v2.1/servers/d0c59b89-6051-4967-81c6-1e9559a7d7b6" status: 200 len: 1315 microversion: 2.1 time: 0.296348 Jun 06 10:38:38.654050 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 25/64] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:38:38 2022] GET /compute/v2.1/servers/d0c59b89-6051-4967-81c6-1e9559a7d7b6 => generated 1315 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:38:38.661690 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-acff4fed-1ebb-4bc2-9fb1-cf82d6e7db5d tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f269e146c844480c822347c3a38d103b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2b17b61b73b4e6d81dd8ffe9cf311ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:38:38.672275 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-acff4fed-1ebb-4bc2-9fb1-cf82d6e7db5d tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] 10.222.0.42 "GET /compute/v2.1/servers/3bdaf03c-d0a2-4d6c-b0f1-ec2d580e63ef" status: 200 len: 1322 microversion: 2.1 time: 0.300532 Jun 06 10:38:38.676762 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-ae6197cc-edcc-4c8d-96e7-0811868aa989 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:38:38.677617 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-ae6197cc-edcc-4c8d-96e7-0811868aa989 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] [instance: f49079c1-1384-4136-b6cf-eadc40fb5aa1] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:38:38.683821 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 40/65] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:38:38 2022] GET /compute/v2.1/servers/3bdaf03c-d0a2-4d6c-b0f1-ec2d580e63ef => generated 1322 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 10:38:38.690127 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-89973f1c-d02d-4be2-9d9b-d9249d3033a0 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:38:38.690906 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-89973f1c-d02d-4be2-9d9b-d9249d3033a0 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] [instance: 5a0a79a6-8e61-477e-8269-730dfb6d04a6] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:38:38.691266 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-ae6197cc-edcc-4c8d-96e7-0811868aa989 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:38:38.691726 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-ae6197cc-edcc-4c8d-96e7-0811868aa989 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:38:38.692545 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-ae6197cc-edcc-4c8d-96e7-0811868aa989 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:38:38.692968 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-ae6197cc-edcc-4c8d-96e7-0811868aa989 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:38:38.699636 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-89973f1c-d02d-4be2-9d9b-d9249d3033a0 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:38:38.700139 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-89973f1c-d02d-4be2-9d9b-d9249d3033a0 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:38:38.701381 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-89973f1c-d02d-4be2-9d9b-d9249d3033a0 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:38:38.701793 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-89973f1c-d02d-4be2-9d9b-d9249d3033a0 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:38:38.905784 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-ae6197cc-edcc-4c8d-96e7-0811868aa989 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b7d82c999646b6b6b96d565f0e3f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe30c756a2f84166ad23af1edf83157e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:38:38.910147 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-89973f1c-d02d-4be2-9d9b-d9249d3033a0 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:38:38.917870 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-ae6197cc-edcc-4c8d-96e7-0811868aa989 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] 10.222.0.42 "GET /compute/v2.1/servers/f49079c1-1384-4136-b6cf-eadc40fb5aa1" status: 200 len: 1363 microversion: 2.1 time: 0.253161 Jun 06 10:38:38.918742 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 26/66] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:38:38 2022] GET /compute/v2.1/servers/f49079c1-1384-4136-b6cf-eadc40fb5aa1 => generated 1363 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:38:38.921841 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-89973f1c-d02d-4be2-9d9b-d9249d3033a0 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:38:38.923581 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-89973f1c-d02d-4be2-9d9b-d9249d3033a0 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:38:38.925008 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-89973f1c-d02d-4be2-9d9b-d9249d3033a0 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0a79a6-8e61-477e-8269-730dfb6d04a6" status: 200 len: 1406 microversion: 2.20 time: 0.239771 Jun 06 10:38:38.925782 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 41/67] 10.222.0.42 () {60 vars in 1276 bytes} [Mon Jun 6 10:38:38 2022] GET /compute/v2.1/servers/5a0a79a6-8e61-477e-8269-730dfb6d04a6 => generated 1406 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 10:38:39.671899 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-3e0fc53a-f555-4f66-9c50-9cbd2cab32b4 tempest-DeleteServersTestJSON-1512496307 tempest-DeleteServersTestJSON-1512496307-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:38:39.672660 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-3e0fc53a-f555-4f66-9c50-9cbd2cab32b4 tempest-DeleteServersTestJSON-1512496307 tempest-DeleteServersTestJSON-1512496307-project] [instance: d0c59b89-6051-4967-81c6-1e9559a7d7b6] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:38:39.678633 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-3e0fc53a-f555-4f66-9c50-9cbd2cab32b4 tempest-DeleteServersTestJSON-1512496307 tempest-DeleteServersTestJSON-1512496307-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:38:39.679084 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-3e0fc53a-f555-4f66-9c50-9cbd2cab32b4 tempest-DeleteServersTestJSON-1512496307 tempest-DeleteServersTestJSON-1512496307-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:38:39.679874 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-3e0fc53a-f555-4f66-9c50-9cbd2cab32b4 tempest-DeleteServersTestJSON-1512496307 tempest-DeleteServersTestJSON-1512496307-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:38:39.680311 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-3e0fc53a-f555-4f66-9c50-9cbd2cab32b4 tempest-DeleteServersTestJSON-1512496307 tempest-DeleteServersTestJSON-1512496307-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:38:39.691177 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-db3b90b9-59c9-4252-bb68-70a543e737d6 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:38:39.691715 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-db3b90b9-59c9-4252-bb68-70a543e737d6 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] [instance: 3bdaf03c-d0a2-4d6c-b0f1-ec2d580e63ef] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:38:39.698685 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-db3b90b9-59c9-4252-bb68-70a543e737d6 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:38:39.699446 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-db3b90b9-59c9-4252-bb68-70a543e737d6 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:38:39.700239 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-db3b90b9-59c9-4252-bb68-70a543e737d6 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:38:39.700672 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-db3b90b9-59c9-4252-bb68-70a543e737d6 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:38:39.908055 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-db3b90b9-59c9-4252-bb68-70a543e737d6 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f269e146c844480c822347c3a38d103b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2b17b61b73b4e6d81dd8ffe9cf311ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:38:39.912429 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-3e0fc53a-f555-4f66-9c50-9cbd2cab32b4 tempest-DeleteServersTestJSON-1512496307 tempest-DeleteServersTestJSON-1512496307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bbc3cd193444a65861f6e6705fd32cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8486d765afed40dc8795c7ba485d9535', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:38:39.916958 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-db3b90b9-59c9-4252-bb68-70a543e737d6 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] 10.222.0.42 "GET /compute/v2.1/servers/3bdaf03c-d0a2-4d6c-b0f1-ec2d580e63ef" status: 200 len: 1322 microversion: 2.1 time: 0.231525 Jun 06 10:38:39.927123 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 42/68] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:38:39 2022] GET /compute/v2.1/servers/3bdaf03c-d0a2-4d6c-b0f1-ec2d580e63ef => generated 1322 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 10:38:39.927201 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-3e0fc53a-f555-4f66-9c50-9cbd2cab32b4 tempest-DeleteServersTestJSON-1512496307 tempest-DeleteServersTestJSON-1512496307-project] 10.222.0.42 "GET /compute/v2.1/servers/d0c59b89-6051-4967-81c6-1e9559a7d7b6" status: 200 len: 1315 microversion: 2.1 time: 0.252667 Jun 06 10:38:39.927201 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 27/69] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:38:39 2022] GET /compute/v2.1/servers/d0c59b89-6051-4967-81c6-1e9559a7d7b6 => generated 1315 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:38:39.935098 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-a27f5d3c-a798-4dc9-bd1e-bee7b81e1a87 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:38:39.936559 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-a27f5d3c-a798-4dc9-bd1e-bee7b81e1a87 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] [instance: f49079c1-1384-4136-b6cf-eadc40fb5aa1] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:38:39.942507 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-a27f5d3c-a798-4dc9-bd1e-bee7b81e1a87 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:38:39.942946 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-a27f5d3c-a798-4dc9-bd1e-bee7b81e1a87 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:38:39.943701 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-a27f5d3c-a798-4dc9-bd1e-bee7b81e1a87 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:38:39.944163 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-a27f5d3c-a798-4dc9-bd1e-bee7b81e1a87 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:38:39.953626 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-17c57336-a03b-473e-84b3-b28ce20b8fa7 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:38:39.954690 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-17c57336-a03b-473e-84b3-b28ce20b8fa7 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] [instance: 5a0a79a6-8e61-477e-8269-730dfb6d04a6] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:38:39.961587 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-17c57336-a03b-473e-84b3-b28ce20b8fa7 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:38:39.962029 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-17c57336-a03b-473e-84b3-b28ce20b8fa7 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:38:39.963276 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-17c57336-a03b-473e-84b3-b28ce20b8fa7 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:38:39.963615 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-17c57336-a03b-473e-84b3-b28ce20b8fa7 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:38:40.156541 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-a27f5d3c-a798-4dc9-bd1e-bee7b81e1a87 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b7d82c999646b6b6b96d565f0e3f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe30c756a2f84166ad23af1edf83157e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:38:40.160574 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-17c57336-a03b-473e-84b3-b28ce20b8fa7 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:38:40.165637 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-a27f5d3c-a798-4dc9-bd1e-bee7b81e1a87 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] 10.222.0.42 "GET /compute/v2.1/servers/f49079c1-1384-4136-b6cf-eadc40fb5aa1" status: 200 len: 1363 microversion: 2.1 time: 0.234117 Jun 06 10:38:40.166207 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 43/70] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:38:39 2022] GET /compute/v2.1/servers/f49079c1-1384-4136-b6cf-eadc40fb5aa1 => generated 1363 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 10:38:40.178522 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-17c57336-a03b-473e-84b3-b28ce20b8fa7 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:38:40.180077 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-17c57336-a03b-473e-84b3-b28ce20b8fa7 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:38:40.181189 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-17c57336-a03b-473e-84b3-b28ce20b8fa7 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0a79a6-8e61-477e-8269-730dfb6d04a6" status: 200 len: 1406 microversion: 2.20 time: 0.237960 Jun 06 10:38:40.181756 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 28/71] 10.222.0.42 () {60 vars in 1276 bytes} [Mon Jun 6 10:38:39 2022] GET /compute/v2.1/servers/5a0a79a6-8e61-477e-8269-730dfb6d04a6 => generated 1406 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 06 10:38:40.936563 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-e9cccde5-1756-44fd-aef2-3d710d9ba9c7 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:38:40.938486 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-665a2690-eda1-42dc-8f42-f544480fbcaa tempest-DeleteServersTestJSON-1512496307 tempest-DeleteServersTestJSON-1512496307-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:38:40.939150 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-665a2690-eda1-42dc-8f42-f544480fbcaa tempest-DeleteServersTestJSON-1512496307 tempest-DeleteServersTestJSON-1512496307-project] [instance: d0c59b89-6051-4967-81c6-1e9559a7d7b6] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:38:40.939540 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-e9cccde5-1756-44fd-aef2-3d710d9ba9c7 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] [instance: 3bdaf03c-d0a2-4d6c-b0f1-ec2d580e63ef] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:38:40.946217 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-e9cccde5-1756-44fd-aef2-3d710d9ba9c7 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:38:40.946958 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-e9cccde5-1756-44fd-aef2-3d710d9ba9c7 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:38:40.948010 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-e9cccde5-1756-44fd-aef2-3d710d9ba9c7 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:38:40.948659 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-e9cccde5-1756-44fd-aef2-3d710d9ba9c7 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:38:40.949166 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-665a2690-eda1-42dc-8f42-f544480fbcaa tempest-DeleteServersTestJSON-1512496307 tempest-DeleteServersTestJSON-1512496307-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:38:40.949621 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-665a2690-eda1-42dc-8f42-f544480fbcaa tempest-DeleteServersTestJSON-1512496307 tempest-DeleteServersTestJSON-1512496307-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:38:40.950410 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-665a2690-eda1-42dc-8f42-f544480fbcaa tempest-DeleteServersTestJSON-1512496307 tempest-DeleteServersTestJSON-1512496307-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:38:40.950886 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-665a2690-eda1-42dc-8f42-f544480fbcaa tempest-DeleteServersTestJSON-1512496307 tempest-DeleteServersTestJSON-1512496307-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:38:41.272596 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-e9cccde5-1756-44fd-aef2-3d710d9ba9c7 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f269e146c844480c822347c3a38d103b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2b17b61b73b4e6d81dd8ffe9cf311ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:38:41.276694 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG dbcounter [-] [129349] Writing DB stats nova_cell1:SELECT=100 {{(pid=129349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 10:38:41.288860 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-e9cccde5-1756-44fd-aef2-3d710d9ba9c7 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] 10.222.0.42 "GET /compute/v2.1/servers/3bdaf03c-d0a2-4d6c-b0f1-ec2d580e63ef" status: 200 len: 1322 microversion: 2.1 time: 0.355342 Jun 06 10:38:41.289589 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 44/72] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:38:40 2022] GET /compute/v2.1/servers/3bdaf03c-d0a2-4d6c-b0f1-ec2d580e63ef => generated 1322 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:38:41.306256 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-665a2690-eda1-42dc-8f42-f544480fbcaa tempest-DeleteServersTestJSON-1512496307 tempest-DeleteServersTestJSON-1512496307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bbc3cd193444a65861f6e6705fd32cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8486d765afed40dc8795c7ba485d9535', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:38:41.309996 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-902e45ad-61ed-412c-816d-514a4ba9d8f7 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:38:41.313637 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-902e45ad-61ed-412c-816d-514a4ba9d8f7 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] [instance: f49079c1-1384-4136-b6cf-eadc40fb5aa1] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:38:41.321171 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-665a2690-eda1-42dc-8f42-f544480fbcaa tempest-DeleteServersTestJSON-1512496307 tempest-DeleteServersTestJSON-1512496307-project] 10.222.0.42 "GET /compute/v2.1/servers/d0c59b89-6051-4967-81c6-1e9559a7d7b6" status: 200 len: 1315 microversion: 2.1 time: 0.387580 Jun 06 10:38:41.321834 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 29/73] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:38:40 2022] GET /compute/v2.1/servers/d0c59b89-6051-4967-81c6-1e9559a7d7b6 => generated 1315 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 10:38:41.331052 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-902e45ad-61ed-412c-816d-514a4ba9d8f7 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:38:41.333782 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-902e45ad-61ed-412c-816d-514a4ba9d8f7 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:38:41.337792 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-902e45ad-61ed-412c-816d-514a4ba9d8f7 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:38:41.338275 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-902e45ad-61ed-412c-816d-514a4ba9d8f7 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:38:41.350010 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-ad6c7c01-b793-4f38-8ee2-64d36ce0322d tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:38:41.350888 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-ad6c7c01-b793-4f38-8ee2-64d36ce0322d tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] [instance: 5a0a79a6-8e61-477e-8269-730dfb6d04a6] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:38:41.364639 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-ad6c7c01-b793-4f38-8ee2-64d36ce0322d tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:38:41.369090 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-ad6c7c01-b793-4f38-8ee2-64d36ce0322d tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:38:41.372000 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-ad6c7c01-b793-4f38-8ee2-64d36ce0322d tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:38:41.372471 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-ad6c7c01-b793-4f38-8ee2-64d36ce0322d tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:38:41.842089 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-ad6c7c01-b793-4f38-8ee2-64d36ce0322d tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:38:41.860370 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-ad6c7c01-b793-4f38-8ee2-64d36ce0322d tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:38:41.861907 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-ad6c7c01-b793-4f38-8ee2-64d36ce0322d tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:38:41.863040 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-ad6c7c01-b793-4f38-8ee2-64d36ce0322d tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0a79a6-8e61-477e-8269-730dfb6d04a6" status: 200 len: 1406 microversion: 2.20 time: 0.529677 Jun 06 10:38:41.868803 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 30/74] 10.222.0.42 () {60 vars in 1276 bytes} [Mon Jun 6 10:38:41 2022] GET /compute/v2.1/servers/5a0a79a6-8e61-477e-8269-730dfb6d04a6 => generated 1406 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 10:38:42.042841 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-902e45ad-61ed-412c-816d-514a4ba9d8f7 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b7d82c999646b6b6b96d565f0e3f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe30c756a2f84166ad23af1edf83157e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:38:42.052212 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-902e45ad-61ed-412c-816d-514a4ba9d8f7 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] 10.222.0.42 "GET /compute/v2.1/servers/f49079c1-1384-4136-b6cf-eadc40fb5aa1" status: 200 len: 1363 microversion: 2.1 time: 0.758039 Jun 06 10:38:42.055203 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 45/75] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:38:41 2022] GET /compute/v2.1/servers/f49079c1-1384-4136-b6cf-eadc40fb5aa1 => generated 1363 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:38:42.306802 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-3fc44e83-d2cc-4084-86b3-ec49c9ea5dd6 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:38:42.307399 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-3fc44e83-d2cc-4084-86b3-ec49c9ea5dd6 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] [instance: 3bdaf03c-d0a2-4d6c-b0f1-ec2d580e63ef] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:38:42.319418 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-3fc44e83-d2cc-4084-86b3-ec49c9ea5dd6 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:38:42.319897 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-3fc44e83-d2cc-4084-86b3-ec49c9ea5dd6 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:38:42.320684 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-3fc44e83-d2cc-4084-86b3-ec49c9ea5dd6 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:38:42.321146 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-3fc44e83-d2cc-4084-86b3-ec49c9ea5dd6 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:38:42.338748 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-193bfd73-f933-479b-b784-a26a8537baf9 tempest-DeleteServersTestJSON-1512496307 tempest-DeleteServersTestJSON-1512496307-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:38:42.339514 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-193bfd73-f933-479b-b784-a26a8537baf9 tempest-DeleteServersTestJSON-1512496307 tempest-DeleteServersTestJSON-1512496307-project] [instance: d0c59b89-6051-4967-81c6-1e9559a7d7b6] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:38:42.348785 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG dbcounter [-] [129349] Writing DB stats nova_cell0:SELECT=4 {{(pid=129349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 10:38:42.351087 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-193bfd73-f933-479b-b784-a26a8537baf9 tempest-DeleteServersTestJSON-1512496307 tempest-DeleteServersTestJSON-1512496307-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:38:42.351640 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-193bfd73-f933-479b-b784-a26a8537baf9 tempest-DeleteServersTestJSON-1512496307 tempest-DeleteServersTestJSON-1512496307-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:38:42.352537 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-193bfd73-f933-479b-b784-a26a8537baf9 tempest-DeleteServersTestJSON-1512496307 tempest-DeleteServersTestJSON-1512496307-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:38:42.358918 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-193bfd73-f933-479b-b784-a26a8537baf9 tempest-DeleteServersTestJSON-1512496307 tempest-DeleteServersTestJSON-1512496307-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:38:43.260290 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-3fc44e83-d2cc-4084-86b3-ec49c9ea5dd6 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f269e146c844480c822347c3a38d103b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2b17b61b73b4e6d81dd8ffe9cf311ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:38:43.274083 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-3fc44e83-d2cc-4084-86b3-ec49c9ea5dd6 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] 10.222.0.42 "GET /compute/v2.1/servers/3bdaf03c-d0a2-4d6c-b0f1-ec2d580e63ef" status: 200 len: 1322 microversion: 2.1 time: 0.971059 Jun 06 10:38:43.279560 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 31/76] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:38:42 2022] GET /compute/v2.1/servers/3bdaf03c-d0a2-4d6c-b0f1-ec2d580e63ef => generated 1322 bytes in 977 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:38:43.285919 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [req-d3202749-7229-497e-92bc-df939fbf9573 req-963e34e7-d17e-4bae-b8be-94650ebbed13 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f49079c1-1384-4136-b6cf-eadc40fb5aa1", "tag": "c68a8af3-23cf-4f43-8b21-304f27c84919"}]} {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 10:38:43.295960 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-193bfd73-f933-479b-b784-a26a8537baf9 tempest-DeleteServersTestJSON-1512496307 tempest-DeleteServersTestJSON-1512496307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bbc3cd193444a65861f6e6705fd32cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8486d765afed40dc8795c7ba485d9535', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:38:43.306957 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-193bfd73-f933-479b-b784-a26a8537baf9 tempest-DeleteServersTestJSON-1512496307 tempest-DeleteServersTestJSON-1512496307-project] 10.222.0.42 "GET /compute/v2.1/servers/d0c59b89-6051-4967-81c6-1e9559a7d7b6" status: 200 len: 1315 microversion: 2.1 time: 0.972301 Jun 06 10:38:43.318887 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [req-d3202749-7229-497e-92bc-df939fbf9573 req-963e34e7-d17e-4bae-b8be-94650ebbed13 service nova] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:38:43.318887 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [req-d3202749-7229-497e-92bc-df939fbf9573 req-963e34e7-d17e-4bae-b8be-94650ebbed13 service nova] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:38:43.319401 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 46/77] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:38:42 2022] GET /compute/v2.1/servers/d0c59b89-6051-4967-81c6-1e9559a7d7b6 => generated 1315 bytes in 982 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:38:43.335543 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-c2bd9f4d-df4c-4866-ae80-8c61cbb145d9 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:38:43.336390 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-c2bd9f4d-df4c-4866-ae80-8c61cbb145d9 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] [instance: 5a0a79a6-8e61-477e-8269-730dfb6d04a6] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:38:43.342615 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.compute.server_external_events [req-d3202749-7229-497e-92bc-df939fbf9573 req-963e34e7-d17e-4bae-b8be-94650ebbed13 service nova] Creating event network-changed:c68a8af3-23cf-4f43-8b21-304f27c84919 for instance f49079c1-1384-4136-b6cf-eadc40fb5aa1 on hv-cinder-84482 Jun 06 10:38:43.352347 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [req-d3202749-7229-497e-92bc-df939fbf9573 req-963e34e7-d17e-4bae-b8be-94650ebbed13 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070975 Jun 06 10:38:43.352967 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 32/78] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Jun 6 10:38:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 10:38:43.354087 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-c2bd9f4d-df4c-4866-ae80-8c61cbb145d9 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:38:43.356007 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-c2bd9f4d-df4c-4866-ae80-8c61cbb145d9 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:38:43.357807 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-c2bd9f4d-df4c-4866-ae80-8c61cbb145d9 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:38:43.360706 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-c2bd9f4d-df4c-4866-ae80-8c61cbb145d9 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:38:43.364637 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-f6351946-ca04-4608-8185-b3acec326d3a tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:38:43.367591 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-f6351946-ca04-4608-8185-b3acec326d3a tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] [instance: f49079c1-1384-4136-b6cf-eadc40fb5aa1] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:38:43.390953 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-f6351946-ca04-4608-8185-b3acec326d3a tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:38:43.391768 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-f6351946-ca04-4608-8185-b3acec326d3a tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:38:43.392749 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-f6351946-ca04-4608-8185-b3acec326d3a tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:38:43.393448 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-f6351946-ca04-4608-8185-b3acec326d3a tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:38:43.751153 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG dbcounter [-] [129349] Writing DB stats nova_cell0:SELECT=10 {{(pid=129349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 10:38:43.784932 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG dbcounter [-] [129350] Writing DB stats nova_cell0:SELECT=26 {{(pid=129350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 10:38:44.247015 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-c2bd9f4d-df4c-4866-ae80-8c61cbb145d9 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:38:44.262689 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-c2bd9f4d-df4c-4866-ae80-8c61cbb145d9 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:38:44.268398 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-c2bd9f4d-df4c-4866-ae80-8c61cbb145d9 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:38:44.272894 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-c2bd9f4d-df4c-4866-ae80-8c61cbb145d9 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0a79a6-8e61-477e-8269-730dfb6d04a6" status: 200 len: 1406 microversion: 2.20 time: 0.953125 Jun 06 10:38:44.274038 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 47/79] 10.222.0.42 () {60 vars in 1276 bytes} [Mon Jun 6 10:38:43 2022] GET /compute/v2.1/servers/5a0a79a6-8e61-477e-8269-730dfb6d04a6 => generated 1406 bytes in 958 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 10:38:44.289326 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-f6351946-ca04-4608-8185-b3acec326d3a tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b7d82c999646b6b6b96d565f0e3f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe30c756a2f84166ad23af1edf83157e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:38:44.300194 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-f2868769-7979-46a5-9732-7d56563ade00 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:38:44.301090 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-f6351946-ca04-4608-8185-b3acec326d3a tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] 10.222.0.42 "GET /compute/v2.1/servers/f49079c1-1384-4136-b6cf-eadc40fb5aa1" status: 200 len: 1363 microversion: 2.1 time: 0.944400 Jun 06 10:38:44.301677 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 33/80] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:38:43 2022] GET /compute/v2.1/servers/f49079c1-1384-4136-b6cf-eadc40fb5aa1 => generated 1363 bytes in 948 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:38:44.302479 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-f2868769-7979-46a5-9732-7d56563ade00 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] [instance: 3bdaf03c-d0a2-4d6c-b0f1-ec2d580e63ef] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:38:44.308820 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-f2868769-7979-46a5-9732-7d56563ade00 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:38:44.309647 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-f2868769-7979-46a5-9732-7d56563ade00 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:38:44.311507 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-f2868769-7979-46a5-9732-7d56563ade00 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:38:44.312285 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-f2868769-7979-46a5-9732-7d56563ade00 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:38:44.327476 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-d42d35db-bb41-42a8-aa9d-579360b5158b tempest-DeleteServersTestJSON-1512496307 tempest-DeleteServersTestJSON-1512496307-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:38:44.328697 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-d42d35db-bb41-42a8-aa9d-579360b5158b tempest-DeleteServersTestJSON-1512496307 tempest-DeleteServersTestJSON-1512496307-project] [instance: d0c59b89-6051-4967-81c6-1e9559a7d7b6] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:38:44.336729 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-d42d35db-bb41-42a8-aa9d-579360b5158b tempest-DeleteServersTestJSON-1512496307 tempest-DeleteServersTestJSON-1512496307-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:38:44.337831 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-d42d35db-bb41-42a8-aa9d-579360b5158b tempest-DeleteServersTestJSON-1512496307 tempest-DeleteServersTestJSON-1512496307-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:38:44.339343 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-d42d35db-bb41-42a8-aa9d-579360b5158b tempest-DeleteServersTestJSON-1512496307 tempest-DeleteServersTestJSON-1512496307-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:38:44.340156 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-d42d35db-bb41-42a8-aa9d-579360b5158b tempest-DeleteServersTestJSON-1512496307 tempest-DeleteServersTestJSON-1512496307-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:38:44.955202 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-d42d35db-bb41-42a8-aa9d-579360b5158b tempest-DeleteServersTestJSON-1512496307 tempest-DeleteServersTestJSON-1512496307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bbc3cd193444a65861f6e6705fd32cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8486d765afed40dc8795c7ba485d9535', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:38:44.973521 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-d42d35db-bb41-42a8-aa9d-579360b5158b tempest-DeleteServersTestJSON-1512496307 tempest-DeleteServersTestJSON-1512496307-project] 10.222.0.42 "GET /compute/v2.1/servers/d0c59b89-6051-4967-81c6-1e9559a7d7b6" status: 200 len: 1502 microversion: 2.1 time: 0.650924 Jun 06 10:38:44.975154 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 34/81] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:38:44 2022] GET /compute/v2.1/servers/d0c59b89-6051-4967-81c6-1e9559a7d7b6 => generated 1502 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 10:38:44.984283 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [req-832039d9-9187-445e-ae22-1a4bdb5cfb25 req-f9f8db49-5726-45f0-b290-b0d40747cba2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3bdaf03c-d0a2-4d6c-b0f1-ec2d580e63ef", "name": "network-vif-plugged", "status": "completed", "tag": "d62ce760-3526-43c3-ad0f-43053dbe7424"}]} {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 10:38:44.993461 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [req-832039d9-9187-445e-ae22-1a4bdb5cfb25 req-f9f8db49-5726-45f0-b290-b0d40747cba2 service nova] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:38:44.994285 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [req-832039d9-9187-445e-ae22-1a4bdb5cfb25 req-f9f8db49-5726-45f0-b290-b0d40747cba2 service nova] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:38:45.023333 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.compute.server_external_events [req-832039d9-9187-445e-ae22-1a4bdb5cfb25 req-f9f8db49-5726-45f0-b290-b0d40747cba2 service nova] Creating event network-vif-plugged:d62ce760-3526-43c3-ad0f-43053dbe7424 for instance 3bdaf03c-d0a2-4d6c-b0f1-ec2d580e63ef on hv-cinder-84482 Jun 06 10:38:45.031712 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [req-832039d9-9187-445e-ae22-1a4bdb5cfb25 req-f9f8db49-5726-45f0-b290-b0d40747cba2 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054895 Jun 06 10:38:45.032353 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 35/82] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Jun 6 10:38:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 10:38:45.190265 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-f2868769-7979-46a5-9732-7d56563ade00 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f269e146c844480c822347c3a38d103b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2b17b61b73b4e6d81dd8ffe9cf311ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:38:45.208069 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-f2868769-7979-46a5-9732-7d56563ade00 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] 10.222.0.42 "GET /compute/v2.1/servers/3bdaf03c-d0a2-4d6c-b0f1-ec2d580e63ef" status: 200 len: 1322 microversion: 2.1 time: 0.914667 Jun 06 10:38:45.210369 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 48/83] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:38:44 2022] GET /compute/v2.1/servers/3bdaf03c-d0a2-4d6c-b0f1-ec2d580e63ef => generated 1322 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:38:45.294886 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-41a3329d-0218-4c65-8222-ab760acb758a tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:38:45.295596 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-41a3329d-0218-4c65-8222-ab760acb758a tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] [instance: 5a0a79a6-8e61-477e-8269-730dfb6d04a6] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:38:45.318928 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-0029a9b5-5d13-45c2-a777-16996c49f341 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:38:45.319841 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-0029a9b5-5d13-45c2-a777-16996c49f341 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] [instance: f49079c1-1384-4136-b6cf-eadc40fb5aa1] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:38:45.329390 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-41a3329d-0218-4c65-8222-ab760acb758a tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:38:45.330145 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-41a3329d-0218-4c65-8222-ab760acb758a tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:38:45.337152 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-0029a9b5-5d13-45c2-a777-16996c49f341 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:38:45.341191 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-0029a9b5-5d13-45c2-a777-16996c49f341 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:38:45.341563 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-41a3329d-0218-4c65-8222-ab760acb758a tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:38:45.342166 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-41a3329d-0218-4c65-8222-ab760acb758a tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:38:45.342294 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-0029a9b5-5d13-45c2-a777-16996c49f341 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:38:45.342860 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-0029a9b5-5d13-45c2-a777-16996c49f341 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:38:45.630314 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-41a3329d-0218-4c65-8222-ab760acb758a tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:38:45.640233 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-41a3329d-0218-4c65-8222-ab760acb758a tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:38:45.646246 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-41a3329d-0218-4c65-8222-ab760acb758a tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:38:45.647271 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-41a3329d-0218-4c65-8222-ab760acb758a tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0a79a6-8e61-477e-8269-730dfb6d04a6" status: 200 len: 1406 microversion: 2.20 time: 0.359288 Jun 06 10:38:45.652990 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 36/84] 10.222.0.42 () {60 vars in 1276 bytes} [Mon Jun 6 10:38:45 2022] GET /compute/v2.1/servers/5a0a79a6-8e61-477e-8269-730dfb6d04a6 => generated 1406 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 10:38:45.656240 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-0029a9b5-5d13-45c2-a777-16996c49f341 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b7d82c999646b6b6b96d565f0e3f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe30c756a2f84166ad23af1edf83157e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:38:45.658114 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [req-fb2f19db-250d-44a0-ae4f-2795452aa7b3 req-79a727a7-0d96-4457-abd4-c0bd0c7243b6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5a0a79a6-8e61-477e-8269-730dfb6d04a6", "tag": "581fdfa4-6fbc-445e-ad43-e4ef71127c0e"}]} {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 10:38:45.667008 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [req-fb2f19db-250d-44a0-ae4f-2795452aa7b3 req-79a727a7-0d96-4457-abd4-c0bd0c7243b6 service nova] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:38:45.667646 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [req-fb2f19db-250d-44a0-ae4f-2795452aa7b3 req-79a727a7-0d96-4457-abd4-c0bd0c7243b6 service nova] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:38:45.667818 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-0029a9b5-5d13-45c2-a777-16996c49f341 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] 10.222.0.42 "GET /compute/v2.1/servers/f49079c1-1384-4136-b6cf-eadc40fb5aa1" status: 200 len: 1363 microversion: 2.1 time: 0.352937 Jun 06 10:38:45.668562 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 49/85] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:38:45 2022] GET /compute/v2.1/servers/f49079c1-1384-4136-b6cf-eadc40fb5aa1 => generated 1363 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:38:45.686363 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.compute.server_external_events [req-fb2f19db-250d-44a0-ae4f-2795452aa7b3 req-79a727a7-0d96-4457-abd4-c0bd0c7243b6 service nova] Creating event network-changed:581fdfa4-6fbc-445e-ad43-e4ef71127c0e for instance 5a0a79a6-8e61-477e-8269-730dfb6d04a6 on hv-cinder-84482 Jun 06 10:38:45.699721 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [req-fb2f19db-250d-44a0-ae4f-2795452aa7b3 req-79a727a7-0d96-4457-abd4-c0bd0c7243b6 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045290 Jun 06 10:38:45.703915 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 37/86] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Jun 6 10:38:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 10:38:46.231220 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-924b625b-0fcd-49c4-90ec-fa8490896a91 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:38:46.233009 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-924b625b-0fcd-49c4-90ec-fa8490896a91 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] [instance: 3bdaf03c-d0a2-4d6c-b0f1-ec2d580e63ef] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:38:46.241561 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-924b625b-0fcd-49c4-90ec-fa8490896a91 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:38:46.243741 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-924b625b-0fcd-49c4-90ec-fa8490896a91 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:38:46.245272 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-924b625b-0fcd-49c4-90ec-fa8490896a91 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:38:46.256446 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-924b625b-0fcd-49c4-90ec-fa8490896a91 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:38:46.501474 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-924b625b-0fcd-49c4-90ec-fa8490896a91 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f269e146c844480c822347c3a38d103b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2b17b61b73b4e6d81dd8ffe9cf311ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:38:46.510090 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-924b625b-0fcd-49c4-90ec-fa8490896a91 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] 10.222.0.42 "GET /compute/v2.1/servers/3bdaf03c-d0a2-4d6c-b0f1-ec2d580e63ef" status: 200 len: 1322 microversion: 2.1 time: 0.286839 Jun 06 10:38:46.510821 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 50/87] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:38:46 2022] GET /compute/v2.1/servers/3bdaf03c-d0a2-4d6c-b0f1-ec2d580e63ef => generated 1322 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:38:46.662573 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG dbcounter [-] [129350] Writing DB stats nova_cell0:SELECT=8 {{(pid=129350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 10:38:46.669531 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-9ed4f4b0-c171-49a5-adaf-ce344d12e1a4 tempest-DeleteServersTestJSON-1512496307 tempest-DeleteServersTestJSON-1512496307-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "89ff385d-d77b-4083-877f-7d5a0b6812de"}} {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 10:38:46.670965 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-9ed4f4b0-c171-49a5-adaf-ce344d12e1a4 tempest-DeleteServersTestJSON-1512496307 tempest-DeleteServersTestJSON-1512496307-project] [instance: d0c59b89-6051-4967-81c6-1e9559a7d7b6] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:38:46.677019 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-a255e680-a21f-480c-bf0f-61d5b7acc7d2 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:38:46.679055 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-a255e680-a21f-480c-bf0f-61d5b7acc7d2 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] [instance: 5a0a79a6-8e61-477e-8269-730dfb6d04a6] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:38:46.679893 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-9ed4f4b0-c171-49a5-adaf-ce344d12e1a4 tempest-DeleteServersTestJSON-1512496307 tempest-DeleteServersTestJSON-1512496307-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:38:46.681071 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-9ed4f4b0-c171-49a5-adaf-ce344d12e1a4 tempest-DeleteServersTestJSON-1512496307 tempest-DeleteServersTestJSON-1512496307-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:38:46.683310 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-9ed4f4b0-c171-49a5-adaf-ce344d12e1a4 tempest-DeleteServersTestJSON-1512496307 tempest-DeleteServersTestJSON-1512496307-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:38:46.683967 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-9ed4f4b0-c171-49a5-adaf-ce344d12e1a4 tempest-DeleteServersTestJSON-1512496307 tempest-DeleteServersTestJSON-1512496307-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:38:46.697445 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-a255e680-a21f-480c-bf0f-61d5b7acc7d2 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:38:46.698604 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-a255e680-a21f-480c-bf0f-61d5b7acc7d2 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:38:46.701893 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-a255e680-a21f-480c-bf0f-61d5b7acc7d2 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:38:46.702692 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-a255e680-a21f-480c-bf0f-61d5b7acc7d2 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:38:46.880383 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-a255e680-a21f-480c-bf0f-61d5b7acc7d2 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:38:46.889692 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-a255e680-a21f-480c-bf0f-61d5b7acc7d2 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:38:46.891267 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-a255e680-a21f-480c-bf0f-61d5b7acc7d2 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:38:46.892411 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-a255e680-a21f-480c-bf0f-61d5b7acc7d2 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0a79a6-8e61-477e-8269-730dfb6d04a6" status: 200 len: 1406 microversion: 2.20 time: 0.230781 Jun 06 10:38:46.892971 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 38/88] 10.222.0.42 () {60 vars in 1276 bytes} [Mon Jun 6 10:38:46 2022] GET /compute/v2.1/servers/5a0a79a6-8e61-477e-8269-730dfb6d04a6 => generated 1406 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 10:38:46.897894 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-82933bca-e5f5-4c8c-9253-48ec0ad57905 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:38:46.898493 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-82933bca-e5f5-4c8c-9253-48ec0ad57905 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] [instance: f49079c1-1384-4136-b6cf-eadc40fb5aa1] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:38:46.904549 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-82933bca-e5f5-4c8c-9253-48ec0ad57905 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:38:46.904993 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-82933bca-e5f5-4c8c-9253-48ec0ad57905 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:38:46.905755 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-82933bca-e5f5-4c8c-9253-48ec0ad57905 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:38:46.906193 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-82933bca-e5f5-4c8c-9253-48ec0ad57905 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:38:46.910223 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG dbcounter [-] [129350] Writing DB stats nova_cell1:SELECT=100 {{(pid=129350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 10:38:47.187040 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-82933bca-e5f5-4c8c-9253-48ec0ad57905 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b7d82c999646b6b6b96d565f0e3f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe30c756a2f84166ad23af1edf83157e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:38:47.200349 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-82933bca-e5f5-4c8c-9253-48ec0ad57905 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] 10.222.0.42 "GET /compute/v2.1/servers/f49079c1-1384-4136-b6cf-eadc40fb5aa1" status: 200 len: 1363 microversion: 2.1 time: 0.305854 Jun 06 10:38:47.212151 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 39/89] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:38:46 2022] GET /compute/v2.1/servers/f49079c1-1384-4136-b6cf-eadc40fb5aa1 => generated 1363 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:38:47.219517 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [req-c2fe9d04-a9ff-4864-9405-68a7fd3ee3f0 req-c70cf926-2eb7-4ee4-adcb-0be14dde71ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6345448b-01b7-4429-bb10-fc5ae449ef71", "name": "network-vif-plugged", "status": "completed", "tag": "78530f9c-98da-46f9-99ec-e1825fb9f8d3"}]} {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 10:38:47.229088 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [req-c2fe9d04-a9ff-4864-9405-68a7fd3ee3f0 req-c70cf926-2eb7-4ee4-adcb-0be14dde71ba service nova] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:38:47.229574 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [req-c2fe9d04-a9ff-4864-9405-68a7fd3ee3f0 req-c70cf926-2eb7-4ee4-adcb-0be14dde71ba service nova] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:38:47.241019 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.compute.server_external_events [req-c2fe9d04-a9ff-4864-9405-68a7fd3ee3f0 req-c70cf926-2eb7-4ee4-adcb-0be14dde71ba service nova] Creating event network-vif-plugged:78530f9c-98da-46f9-99ec-e1825fb9f8d3 for instance 6345448b-01b7-4429-bb10-fc5ae449ef71 on hv-cinder-84482 Jun 06 10:38:47.245755 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [req-c2fe9d04-a9ff-4864-9405-68a7fd3ee3f0 req-c70cf926-2eb7-4ee4-adcb-0be14dde71ba service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031984 Jun 06 10:38:47.246417 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 40/90] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Jun 6 10:38:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 10:38:47.368271 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-9ed4f4b0-c171-49a5-adaf-ce344d12e1a4 tempest-DeleteServersTestJSON-1512496307 tempest-DeleteServersTestJSON-1512496307-project] 10.222.0.42 "POST /compute/v2.1/servers/d0c59b89-6051-4967-81c6-1e9559a7d7b6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.702651 Jun 06 10:38:47.369442 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 51/91] 10.222.0.42 () {60 vars in 1322 bytes} [Mon Jun 6 10:38:46 2022] POST /compute/v2.1/servers/d0c59b89-6051-4967-81c6-1e9559a7d7b6/os-volume_attachments => generated 194 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 10:38:47.529929 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-0bd860ab-ba85-4f3f-9479-d3728fa118a2 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:38:47.530640 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-0bd860ab-ba85-4f3f-9479-d3728fa118a2 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] [instance: 3bdaf03c-d0a2-4d6c-b0f1-ec2d580e63ef] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:38:47.549027 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-0bd860ab-ba85-4f3f-9479-d3728fa118a2 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:38:47.552167 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-0bd860ab-ba85-4f3f-9479-d3728fa118a2 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:38:47.553337 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-0bd860ab-ba85-4f3f-9479-d3728fa118a2 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:38:47.553784 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-0bd860ab-ba85-4f3f-9479-d3728fa118a2 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:38:47.911193 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-61a93cbc-1651-4302-837f-cdcaea1c77cd tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:38:47.912028 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-61a93cbc-1651-4302-837f-cdcaea1c77cd tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] [instance: 5a0a79a6-8e61-477e-8269-730dfb6d04a6] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:38:47.934571 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-61a93cbc-1651-4302-837f-cdcaea1c77cd tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:38:47.935586 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-61a93cbc-1651-4302-837f-cdcaea1c77cd tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:38:47.936860 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-61a93cbc-1651-4302-837f-cdcaea1c77cd tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:38:47.937312 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-61a93cbc-1651-4302-837f-cdcaea1c77cd tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:38:48.254038 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-0bd860ab-ba85-4f3f-9479-d3728fa118a2 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f269e146c844480c822347c3a38d103b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2b17b61b73b4e6d81dd8ffe9cf311ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:38:48.262502 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-0bd860ab-ba85-4f3f-9479-d3728fa118a2 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] 10.222.0.42 "GET /compute/v2.1/servers/3bdaf03c-d0a2-4d6c-b0f1-ec2d580e63ef" status: 200 len: 1322 microversion: 2.1 time: 0.737401 Jun 06 10:38:48.266848 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 41/92] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:38:47 2022] GET /compute/v2.1/servers/3bdaf03c-d0a2-4d6c-b0f1-ec2d580e63ef => generated 1322 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:38:48.283878 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-87e3c2b0-e489-4ae0-b55d-6ff7d75994a2 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:38:48.286948 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-87e3c2b0-e489-4ae0-b55d-6ff7d75994a2 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] [instance: f49079c1-1384-4136-b6cf-eadc40fb5aa1] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:38:48.302681 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-87e3c2b0-e489-4ae0-b55d-6ff7d75994a2 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:38:48.304897 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-87e3c2b0-e489-4ae0-b55d-6ff7d75994a2 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:38:48.305912 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-87e3c2b0-e489-4ae0-b55d-6ff7d75994a2 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:38:48.306922 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-87e3c2b0-e489-4ae0-b55d-6ff7d75994a2 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:38:48.704452 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-61a93cbc-1651-4302-837f-cdcaea1c77cd tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:38:48.717434 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-61a93cbc-1651-4302-837f-cdcaea1c77cd tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:38:48.722877 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-61a93cbc-1651-4302-837f-cdcaea1c77cd tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:38:48.725185 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-61a93cbc-1651-4302-837f-cdcaea1c77cd tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0a79a6-8e61-477e-8269-730dfb6d04a6" status: 200 len: 1406 microversion: 2.20 time: 0.818284 Jun 06 10:38:48.728097 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 52/93] 10.222.0.42 () {60 vars in 1276 bytes} [Mon Jun 6 10:38:47 2022] GET /compute/v2.1/servers/5a0a79a6-8e61-477e-8269-730dfb6d04a6 => generated 1406 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 06 10:38:48.792018 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-87e3c2b0-e489-4ae0-b55d-6ff7d75994a2 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b7d82c999646b6b6b96d565f0e3f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe30c756a2f84166ad23af1edf83157e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:38:48.801029 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-87e3c2b0-e489-4ae0-b55d-6ff7d75994a2 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] 10.222.0.42 "GET /compute/v2.1/servers/f49079c1-1384-4136-b6cf-eadc40fb5aa1" status: 200 len: 1363 microversion: 2.1 time: 0.529438 Jun 06 10:38:48.801607 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 42/94] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:38:48 2022] GET /compute/v2.1/servers/f49079c1-1384-4136-b6cf-eadc40fb5aa1 => generated 1363 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:38:49.282245 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-6fc45f54-6b2a-471a-9167-7b53c72de47e tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:38:49.283025 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-6fc45f54-6b2a-471a-9167-7b53c72de47e tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] [instance: 3bdaf03c-d0a2-4d6c-b0f1-ec2d580e63ef] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:38:49.296054 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-6fc45f54-6b2a-471a-9167-7b53c72de47e tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:38:49.296502 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-6fc45f54-6b2a-471a-9167-7b53c72de47e tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:38:49.297298 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-6fc45f54-6b2a-471a-9167-7b53c72de47e tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:38:49.297739 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-6fc45f54-6b2a-471a-9167-7b53c72de47e tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:38:49.515510 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-6fc45f54-6b2a-471a-9167-7b53c72de47e tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f269e146c844480c822347c3a38d103b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2b17b61b73b4e6d81dd8ffe9cf311ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:38:49.530216 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-6fc45f54-6b2a-471a-9167-7b53c72de47e tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] 10.222.0.42 "GET /compute/v2.1/servers/3bdaf03c-d0a2-4d6c-b0f1-ec2d580e63ef" status: 200 len: 1516 microversion: 2.1 time: 0.252065 Jun 06 10:38:49.532317 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 53/95] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:38:49 2022] GET /compute/v2.1/servers/3bdaf03c-d0a2-4d6c-b0f1-ec2d580e63ef => generated 1516 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:38:49.548908 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-a1fb6567-dbfc-44d5-8514-d75ed346c042 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 10:38:49.550059 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-a1fb6567-dbfc-44d5-8514-d75ed346c042 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] [instance: 3bdaf03c-d0a2-4d6c-b0f1-ec2d580e63ef] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:38:49.556164 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-a1fb6567-dbfc-44d5-8514-d75ed346c042 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:38:49.556620 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-a1fb6567-dbfc-44d5-8514-d75ed346c042 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:38:49.557389 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-a1fb6567-dbfc-44d5-8514-d75ed346c042 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:38:49.557829 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-a1fb6567-dbfc-44d5-8514-d75ed346c042 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:38:49.618173 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.objects.instance [None req-a1fb6567-dbfc-44d5-8514-d75ed346c042 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lazy-loading 'flavor' on Instance uuid 3bdaf03c-d0a2-4d6c-b0f1-ec2d580e63ef {{(pid=129350) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 06 10:38:49.741168 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-a1fb6567-dbfc-44d5-8514-d75ed346c042 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] 10.222.0.42 "POST /compute/v2.1/servers/3bdaf03c-d0a2-4d6c-b0f1-ec2d580e63ef/action" status: 200 len: 32 microversion: 2.1 time: 0.196078 Jun 06 10:38:49.742038 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 43/96] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Jun 6 10:38:49 2022] POST /compute/v2.1/servers/3bdaf03c-d0a2-4d6c-b0f1-ec2d580e63ef/action => generated 32 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 06 10:38:49.744882 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-97c0980c-d124-414a-9c25-933b26a889af tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:38:49.745502 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-97c0980c-d124-414a-9c25-933b26a889af tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] [instance: 5a0a79a6-8e61-477e-8269-730dfb6d04a6] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:38:49.751319 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-351dca72-0684-49dd-8128-7b3de9e17624 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:38:49.752074 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-351dca72-0684-49dd-8128-7b3de9e17624 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] [instance: 3bdaf03c-d0a2-4d6c-b0f1-ec2d580e63ef] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:38:49.752877 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-97c0980c-d124-414a-9c25-933b26a889af tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:38:49.753402 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-97c0980c-d124-414a-9c25-933b26a889af tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:38:49.754271 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-97c0980c-d124-414a-9c25-933b26a889af tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:38:49.754810 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-97c0980c-d124-414a-9c25-933b26a889af tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:38:49.760000 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-351dca72-0684-49dd-8128-7b3de9e17624 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:38:49.760000 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-351dca72-0684-49dd-8128-7b3de9e17624 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:38:49.760235 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-351dca72-0684-49dd-8128-7b3de9e17624 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:38:49.760684 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-351dca72-0684-49dd-8128-7b3de9e17624 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:38:49.966771 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-351dca72-0684-49dd-8128-7b3de9e17624 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f269e146c844480c822347c3a38d103b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2b17b61b73b4e6d81dd8ffe9cf311ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:38:49.967766 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-97c0980c-d124-414a-9c25-933b26a889af tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:38:49.977197 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-351dca72-0684-49dd-8128-7b3de9e17624 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] 10.222.0.42 "GET /compute/v2.1/servers/3bdaf03c-d0a2-4d6c-b0f1-ec2d580e63ef" status: 200 len: 1522 microversion: 2.1 time: 0.229999 Jun 06 10:38:49.977374 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-97c0980c-d124-414a-9c25-933b26a889af tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:38:49.977949 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 44/97] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:38:49 2022] GET /compute/v2.1/servers/3bdaf03c-d0a2-4d6c-b0f1-ec2d580e63ef => generated 1522 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 10:38:49.980478 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-97c0980c-d124-414a-9c25-933b26a889af tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:38:49.981592 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-97c0980c-d124-414a-9c25-933b26a889af tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0a79a6-8e61-477e-8269-730dfb6d04a6" status: 200 len: 1406 microversion: 2.20 time: 0.240624 Jun 06 10:38:49.982208 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 54/98] 10.222.0.42 () {60 vars in 1276 bytes} [Mon Jun 6 10:38:49 2022] GET /compute/v2.1/servers/5a0a79a6-8e61-477e-8269-730dfb6d04a6 => generated 1406 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 06 10:38:49.983379 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-a87a5e92-b978-46f1-8ae5-248eb765e660 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:38:49.984216 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-a87a5e92-b978-46f1-8ae5-248eb765e660 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] [instance: f49079c1-1384-4136-b6cf-eadc40fb5aa1] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:38:49.994095 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-a87a5e92-b978-46f1-8ae5-248eb765e660 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:38:49.997084 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-a87a5e92-b978-46f1-8ae5-248eb765e660 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:38:49.998570 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-a87a5e92-b978-46f1-8ae5-248eb765e660 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:38:49.999009 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-a87a5e92-b978-46f1-8ae5-248eb765e660 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:38:50.249072 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-a87a5e92-b978-46f1-8ae5-248eb765e660 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b7d82c999646b6b6b96d565f0e3f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe30c756a2f84166ad23af1edf83157e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:38:50.260191 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-a87a5e92-b978-46f1-8ae5-248eb765e660 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] 10.222.0.42 "GET /compute/v2.1/servers/f49079c1-1384-4136-b6cf-eadc40fb5aa1" status: 200 len: 1363 microversion: 2.1 time: 0.280849 Jun 06 10:38:50.261362 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 45/99] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:38:49 2022] GET /compute/v2.1/servers/f49079c1-1384-4136-b6cf-eadc40fb5aa1 => generated 1363 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:38:50.811198 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [req-3cd41c5e-5417-4d60-ac0d-8b92fc37cffb req-54f72ff9-02a4-42b8-9b95-40efb53cec2e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a0a79a6-8e61-477e-8269-730dfb6d04a6", "name": "network-vif-plugged", "status": "completed", "tag": "581fdfa4-6fbc-445e-ad43-e4ef71127c0e"}]} {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 10:38:50.826175 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [req-3cd41c5e-5417-4d60-ac0d-8b92fc37cffb req-54f72ff9-02a4-42b8-9b95-40efb53cec2e service nova] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:38:50.827094 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [req-3cd41c5e-5417-4d60-ac0d-8b92fc37cffb req-54f72ff9-02a4-42b8-9b95-40efb53cec2e service nova] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:38:50.851041 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.compute.server_external_events [req-3cd41c5e-5417-4d60-ac0d-8b92fc37cffb req-54f72ff9-02a4-42b8-9b95-40efb53cec2e service nova] Creating event network-vif-plugged:581fdfa4-6fbc-445e-ad43-e4ef71127c0e for instance 5a0a79a6-8e61-477e-8269-730dfb6d04a6 on hv-cinder-84482 Jun 06 10:38:50.862571 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [req-3cd41c5e-5417-4d60-ac0d-8b92fc37cffb req-54f72ff9-02a4-42b8-9b95-40efb53cec2e service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058137 Jun 06 10:38:50.866496 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 55/100] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Jun 6 10:38:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 06 10:38:50.998548 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-d47c629c-9016-4b80-9b1b-2159e2c2e621 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:38:50.999173 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-d47c629c-9016-4b80-9b1b-2159e2c2e621 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] [instance: 3bdaf03c-d0a2-4d6c-b0f1-ec2d580e63ef] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:38:51.007589 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-42a026cb-0a36-4286-a165-a3c4aa61ba8c tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:38:51.008967 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-42a026cb-0a36-4286-a165-a3c4aa61ba8c tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] [instance: 5a0a79a6-8e61-477e-8269-730dfb6d04a6] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:38:51.011579 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-d47c629c-9016-4b80-9b1b-2159e2c2e621 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:38:51.014929 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-d47c629c-9016-4b80-9b1b-2159e2c2e621 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:38:51.018774 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-d47c629c-9016-4b80-9b1b-2159e2c2e621 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:38:51.019584 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-d47c629c-9016-4b80-9b1b-2159e2c2e621 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:38:51.023399 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-42a026cb-0a36-4286-a165-a3c4aa61ba8c tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:38:51.024323 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-42a026cb-0a36-4286-a165-a3c4aa61ba8c tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:38:51.027129 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-42a026cb-0a36-4286-a165-a3c4aa61ba8c tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:38:51.028739 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-42a026cb-0a36-4286-a165-a3c4aa61ba8c tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:38:51.453063 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-d47c629c-9016-4b80-9b1b-2159e2c2e621 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f269e146c844480c822347c3a38d103b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2b17b61b73b4e6d81dd8ffe9cf311ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:38:51.464846 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-d47c629c-9016-4b80-9b1b-2159e2c2e621 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] 10.222.0.42 "GET /compute/v2.1/servers/3bdaf03c-d0a2-4d6c-b0f1-ec2d580e63ef" status: 200 len: 1522 microversion: 2.1 time: 0.471635 Jun 06 10:38:51.465436 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 46/101] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:38:50 2022] GET /compute/v2.1/servers/3bdaf03c-d0a2-4d6c-b0f1-ec2d580e63ef => generated 1522 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:38:51.472110 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-54070b11-e502-4794-8167-fa9604c8ddf2 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:38:51.472726 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-54070b11-e502-4794-8167-fa9604c8ddf2 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] [instance: f49079c1-1384-4136-b6cf-eadc40fb5aa1] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:38:51.480893 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-42a026cb-0a36-4286-a165-a3c4aa61ba8c tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:38:51.483523 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-54070b11-e502-4794-8167-fa9604c8ddf2 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:38:51.484213 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-54070b11-e502-4794-8167-fa9604c8ddf2 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:38:51.485867 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-54070b11-e502-4794-8167-fa9604c8ddf2 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:38:51.486557 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-54070b11-e502-4794-8167-fa9604c8ddf2 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:38:51.492593 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-42a026cb-0a36-4286-a165-a3c4aa61ba8c tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:38:51.494749 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-42a026cb-0a36-4286-a165-a3c4aa61ba8c tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:38:51.496441 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-42a026cb-0a36-4286-a165-a3c4aa61ba8c tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0a79a6-8e61-477e-8269-730dfb6d04a6" status: 200 len: 1406 microversion: 2.20 time: 0.494945 Jun 06 10:38:51.497742 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 56/102] 10.222.0.42 () {60 vars in 1276 bytes} [Mon Jun 6 10:38:50 2022] GET /compute/v2.1/servers/5a0a79a6-8e61-477e-8269-730dfb6d04a6 => generated 1406 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 10:38:51.704410 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-54070b11-e502-4794-8167-fa9604c8ddf2 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b7d82c999646b6b6b96d565f0e3f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe30c756a2f84166ad23af1edf83157e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:38:51.715416 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-54070b11-e502-4794-8167-fa9604c8ddf2 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] 10.222.0.42 "GET /compute/v2.1/servers/f49079c1-1384-4136-b6cf-eadc40fb5aa1" status: 200 len: 1363 microversion: 2.1 time: 0.248962 Jun 06 10:38:51.716122 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 47/103] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:38:51 2022] GET /compute/v2.1/servers/f49079c1-1384-4136-b6cf-eadc40fb5aa1 => generated 1363 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:38:52.481461 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-6a3e8526-b32b-4fe9-98a2-b4ee4eac0404 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:38:52.482759 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-6a3e8526-b32b-4fe9-98a2-b4ee4eac0404 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] [instance: 3bdaf03c-d0a2-4d6c-b0f1-ec2d580e63ef] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:38:52.490664 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-6a3e8526-b32b-4fe9-98a2-b4ee4eac0404 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:38:52.491119 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-6a3e8526-b32b-4fe9-98a2-b4ee4eac0404 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:38:52.491979 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-6a3e8526-b32b-4fe9-98a2-b4ee4eac0404 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:38:52.492408 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-6a3e8526-b32b-4fe9-98a2-b4ee4eac0404 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:38:52.515682 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-4e3a012a-41f9-4c5e-b74b-155e779df819 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:38:52.516406 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-4e3a012a-41f9-4c5e-b74b-155e779df819 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] [instance: 5a0a79a6-8e61-477e-8269-730dfb6d04a6] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:38:52.525796 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-4e3a012a-41f9-4c5e-b74b-155e779df819 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:38:52.526249 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-4e3a012a-41f9-4c5e-b74b-155e779df819 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:38:52.527029 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-4e3a012a-41f9-4c5e-b74b-155e779df819 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:38:52.527467 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-4e3a012a-41f9-4c5e-b74b-155e779df819 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:38:52.742406 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-6a3e8526-b32b-4fe9-98a2-b4ee4eac0404 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f269e146c844480c822347c3a38d103b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2b17b61b73b4e6d81dd8ffe9cf311ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:38:52.751598 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-6a3e8526-b32b-4fe9-98a2-b4ee4eac0404 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] 10.222.0.42 "GET /compute/v2.1/servers/3bdaf03c-d0a2-4d6c-b0f1-ec2d580e63ef" status: 200 len: 1522 microversion: 2.1 time: 0.274228 Jun 06 10:38:52.752057 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-4e3a012a-41f9-4c5e-b74b-155e779df819 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:38:52.753879 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 57/104] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:38:52 2022] GET /compute/v2.1/servers/3bdaf03c-d0a2-4d6c-b0f1-ec2d580e63ef => generated 1522 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:38:52.758774 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-cf54f0b1-9ae6-49b3-8d77-2e161dbb71f2 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:38:52.759541 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-cf54f0b1-9ae6-49b3-8d77-2e161dbb71f2 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] [instance: f49079c1-1384-4136-b6cf-eadc40fb5aa1] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:38:52.766735 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-cf54f0b1-9ae6-49b3-8d77-2e161dbb71f2 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:38:52.767186 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-cf54f0b1-9ae6-49b3-8d77-2e161dbb71f2 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:38:52.767992 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-cf54f0b1-9ae6-49b3-8d77-2e161dbb71f2 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:38:52.768682 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-cf54f0b1-9ae6-49b3-8d77-2e161dbb71f2 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:38:52.772880 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-4e3a012a-41f9-4c5e-b74b-155e779df819 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:38:52.774753 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-4e3a012a-41f9-4c5e-b74b-155e779df819 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:38:52.776622 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-4e3a012a-41f9-4c5e-b74b-155e779df819 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0a79a6-8e61-477e-8269-730dfb6d04a6" status: 200 len: 1597 microversion: 2.20 time: 0.265436 Jun 06 10:38:52.777541 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 48/105] 10.222.0.42 () {60 vars in 1276 bytes} [Mon Jun 6 10:38:52 2022] GET /compute/v2.1/servers/5a0a79a6-8e61-477e-8269-730dfb6d04a6 => generated 1597 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 10:38:52.801292 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-9a0c8a14-ec73-4e3d-ac1c-e517fe62b731 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:38:52.802280 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-9a0c8a14-ec73-4e3d-ac1c-e517fe62b731 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] [instance: 5a0a79a6-8e61-477e-8269-730dfb6d04a6] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:38:52.815380 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-9a0c8a14-ec73-4e3d-ac1c-e517fe62b731 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:38:52.816160 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-9a0c8a14-ec73-4e3d-ac1c-e517fe62b731 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:38:52.817346 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-9a0c8a14-ec73-4e3d-ac1c-e517fe62b731 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:38:52.818028 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-9a0c8a14-ec73-4e3d-ac1c-e517fe62b731 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:38:52.971700 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-9a0c8a14-ec73-4e3d-ac1c-e517fe62b731 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0a79a6-8e61-477e-8269-730dfb6d04a6/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.177201 Jun 06 10:38:52.978737 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 49/106] 10.222.0.42 () {60 vars in 1315 bytes} [Mon Jun 6 10:38:52 2022] GET /compute/v2.1/servers/5a0a79a6-8e61-477e-8269-730dfb6d04a6/os-interface => generated 284 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 06 10:38:52.989911 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [req-2bed6de1-7149-4ae4-8b09-74382bb32fa8 req-b6bc1132-610d-4e51-8051-5812b91ceeb5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f49079c1-1384-4136-b6cf-eadc40fb5aa1", "name": "network-vif-plugged", "status": "completed", "tag": "c68a8af3-23cf-4f43-8b21-304f27c84919"}]} {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 10:38:53.015747 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [req-2bed6de1-7149-4ae4-8b09-74382bb32fa8 req-b6bc1132-610d-4e51-8051-5812b91ceeb5 service nova] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:38:53.019584 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [req-2bed6de1-7149-4ae4-8b09-74382bb32fa8 req-b6bc1132-610d-4e51-8051-5812b91ceeb5 service nova] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:38:53.036272 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-cf54f0b1-9ae6-49b3-8d77-2e161dbb71f2 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b7d82c999646b6b6b96d565f0e3f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe30c756a2f84166ad23af1edf83157e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:38:53.047016 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-cf54f0b1-9ae6-49b3-8d77-2e161dbb71f2 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] 10.222.0.42 "GET /compute/v2.1/servers/f49079c1-1384-4136-b6cf-eadc40fb5aa1" status: 200 len: 1363 microversion: 2.1 time: 0.292005 Jun 06 10:38:53.047572 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.compute.server_external_events [req-2bed6de1-7149-4ae4-8b09-74382bb32fa8 req-b6bc1132-610d-4e51-8051-5812b91ceeb5 service nova] Creating event network-vif-plugged:c68a8af3-23cf-4f43-8b21-304f27c84919 for instance f49079c1-1384-4136-b6cf-eadc40fb5aa1 on hv-cinder-84482 Jun 06 10:38:53.055091 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [req-2bed6de1-7149-4ae4-8b09-74382bb32fa8 req-b6bc1132-610d-4e51-8051-5812b91ceeb5 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077499 Jun 06 10:38:53.062340 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 50/107] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Jun 6 10:38:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 10:38:53.064528 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 58/108] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:38:52 2022] GET /compute/v2.1/servers/f49079c1-1384-4136-b6cf-eadc40fb5aa1 => generated 1363 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:38:53.773266 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-cf8165d1-655c-49dc-9c36-c2e6548faa74 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:38:53.774165 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-cf8165d1-655c-49dc-9c36-c2e6548faa74 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] [instance: 3bdaf03c-d0a2-4d6c-b0f1-ec2d580e63ef] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:38:53.783298 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-cf8165d1-655c-49dc-9c36-c2e6548faa74 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:38:53.784311 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-cf8165d1-655c-49dc-9c36-c2e6548faa74 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:38:53.785857 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-cf8165d1-655c-49dc-9c36-c2e6548faa74 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:38:53.786707 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-cf8165d1-655c-49dc-9c36-c2e6548faa74 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:38:54.045982 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-cf8165d1-655c-49dc-9c36-c2e6548faa74 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f269e146c844480c822347c3a38d103b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2b17b61b73b4e6d81dd8ffe9cf311ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:38:54.061474 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-cf8165d1-655c-49dc-9c36-c2e6548faa74 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] 10.222.0.42 "GET /compute/v2.1/servers/3bdaf03c-d0a2-4d6c-b0f1-ec2d580e63ef" status: 200 len: 1522 microversion: 2.1 time: 0.290128 Jun 06 10:38:54.074999 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-a8cb2120-1da8-4863-8795-8d6c14707783 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:38:54.075773 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-a8cb2120-1da8-4863-8795-8d6c14707783 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] [instance: f49079c1-1384-4136-b6cf-eadc40fb5aa1] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:38:54.082764 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 51/109] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:38:53 2022] GET /compute/v2.1/servers/3bdaf03c-d0a2-4d6c-b0f1-ec2d580e63ef => generated 1522 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:38:54.084642 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-a8cb2120-1da8-4863-8795-8d6c14707783 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:38:54.086296 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-a8cb2120-1da8-4863-8795-8d6c14707783 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:38:54.087314 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-a8cb2120-1da8-4863-8795-8d6c14707783 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:38:54.089737 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-a8cb2120-1da8-4863-8795-8d6c14707783 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:38:54.256381 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-a8cb2120-1da8-4863-8795-8d6c14707783 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b7d82c999646b6b6b96d565f0e3f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe30c756a2f84166ad23af1edf83157e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:38:54.264697 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-a8cb2120-1da8-4863-8795-8d6c14707783 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] 10.222.0.42 "GET /compute/v2.1/servers/f49079c1-1384-4136-b6cf-eadc40fb5aa1" status: 200 len: 1363 microversion: 2.1 time: 0.201766 Jun 06 10:38:54.265374 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 59/110] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:38:54 2022] GET /compute/v2.1/servers/f49079c1-1384-4136-b6cf-eadc40fb5aa1 => generated 1363 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:38:54.807717 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [req-7b0fd471-a78f-4a25-bfcc-a6b985b7c594 req-e4df61cd-bdee-4c05-8237-0aef77dc1586 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5a0a79a6-8e61-477e-8269-730dfb6d04a6", "tag": "581fdfa4-6fbc-445e-ad43-e4ef71127c0e"}]} {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 10:38:54.820553 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [req-7b0fd471-a78f-4a25-bfcc-a6b985b7c594 req-e4df61cd-bdee-4c05-8237-0aef77dc1586 service nova] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:38:54.821401 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [req-7b0fd471-a78f-4a25-bfcc-a6b985b7c594 req-e4df61cd-bdee-4c05-8237-0aef77dc1586 service nova] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:38:54.839512 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.compute.server_external_events [req-7b0fd471-a78f-4a25-bfcc-a6b985b7c594 req-e4df61cd-bdee-4c05-8237-0aef77dc1586 service nova] Creating event network-changed:581fdfa4-6fbc-445e-ad43-e4ef71127c0e for instance 5a0a79a6-8e61-477e-8269-730dfb6d04a6 on hv-cinder-84482 Jun 06 10:38:54.852842 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [req-7b0fd471-a78f-4a25-bfcc-a6b985b7c594 req-e4df61cd-bdee-4c05-8237-0aef77dc1586 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050421 Jun 06 10:38:54.854511 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 52/111] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Jun 6 10:38:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 10:38:55.079231 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-60204ede-b528-4c42-98e6-4e568d18dfe4 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:38:55.080561 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-60204ede-b528-4c42-98e6-4e568d18dfe4 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] [instance: 3bdaf03c-d0a2-4d6c-b0f1-ec2d580e63ef] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:38:55.089645 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-60204ede-b528-4c42-98e6-4e568d18dfe4 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:38:55.092731 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-60204ede-b528-4c42-98e6-4e568d18dfe4 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:38:55.094239 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-60204ede-b528-4c42-98e6-4e568d18dfe4 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:38:55.094708 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-60204ede-b528-4c42-98e6-4e568d18dfe4 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:38:55.293226 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-495f51ee-ff24-4b94-ada6-0676e007dffb tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:38:55.295300 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-495f51ee-ff24-4b94-ada6-0676e007dffb tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] [instance: f49079c1-1384-4136-b6cf-eadc40fb5aa1] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:38:55.318237 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-495f51ee-ff24-4b94-ada6-0676e007dffb tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:38:55.319038 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-495f51ee-ff24-4b94-ada6-0676e007dffb tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:38:55.321032 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-495f51ee-ff24-4b94-ada6-0676e007dffb tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:38:55.323271 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-495f51ee-ff24-4b94-ada6-0676e007dffb tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:38:55.461512 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-60204ede-b528-4c42-98e6-4e568d18dfe4 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f269e146c844480c822347c3a38d103b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2b17b61b73b4e6d81dd8ffe9cf311ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:38:55.465303 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG dbcounter [-] [129349] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 10:38:55.473583 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-60204ede-b528-4c42-98e6-4e568d18dfe4 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] 10.222.0.42 "GET /compute/v2.1/servers/3bdaf03c-d0a2-4d6c-b0f1-ec2d580e63ef" status: 200 len: 1522 microversion: 2.1 time: 0.398896 Jun 06 10:38:55.474171 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 60/112] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:38:55 2022] GET /compute/v2.1/servers/3bdaf03c-d0a2-4d6c-b0f1-ec2d580e63ef => generated 1522 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:38:55.542987 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-495f51ee-ff24-4b94-ada6-0676e007dffb tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b7d82c999646b6b6b96d565f0e3f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe30c756a2f84166ad23af1edf83157e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:38:55.553295 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-495f51ee-ff24-4b94-ada6-0676e007dffb tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] 10.222.0.42 "GET /compute/v2.1/servers/f49079c1-1384-4136-b6cf-eadc40fb5aa1" status: 200 len: 1363 microversion: 2.1 time: 0.271912 Jun 06 10:38:55.554366 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 53/113] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:38:55 2022] GET /compute/v2.1/servers/f49079c1-1384-4136-b6cf-eadc40fb5aa1 => generated 1363 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:38:56.493166 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-78961052-6c82-480c-93a4-75a0aa06e75a tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:38:56.493918 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-78961052-6c82-480c-93a4-75a0aa06e75a tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] [instance: 3bdaf03c-d0a2-4d6c-b0f1-ec2d580e63ef] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:38:56.505179 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-78961052-6c82-480c-93a4-75a0aa06e75a tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:38:56.505668 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-78961052-6c82-480c-93a4-75a0aa06e75a tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:38:56.506448 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-78961052-6c82-480c-93a4-75a0aa06e75a tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:38:56.506879 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-78961052-6c82-480c-93a4-75a0aa06e75a tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:38:56.570278 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-9b7080c3-dade-4406-b904-5d8723ddb3c4 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:38:56.570961 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-9b7080c3-dade-4406-b904-5d8723ddb3c4 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] [instance: f49079c1-1384-4136-b6cf-eadc40fb5aa1] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:38:56.582701 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-9b7080c3-dade-4406-b904-5d8723ddb3c4 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:38:56.583158 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-9b7080c3-dade-4406-b904-5d8723ddb3c4 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:38:56.584040 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-9b7080c3-dade-4406-b904-5d8723ddb3c4 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:38:56.584483 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-9b7080c3-dade-4406-b904-5d8723ddb3c4 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:38:56.787042 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-78961052-6c82-480c-93a4-75a0aa06e75a tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f269e146c844480c822347c3a38d103b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2b17b61b73b4e6d81dd8ffe9cf311ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:38:56.798875 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-78961052-6c82-480c-93a4-75a0aa06e75a tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] 10.222.0.42 "GET /compute/v2.1/servers/3bdaf03c-d0a2-4d6c-b0f1-ec2d580e63ef" status: 200 len: 1522 microversion: 2.1 time: 0.310452 Jun 06 10:38:56.801104 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 61/114] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:38:56 2022] GET /compute/v2.1/servers/3bdaf03c-d0a2-4d6c-b0f1-ec2d580e63ef => generated 1522 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:38:56.828809 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-9b7080c3-dade-4406-b904-5d8723ddb3c4 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b7d82c999646b6b6b96d565f0e3f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe30c756a2f84166ad23af1edf83157e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:38:56.837071 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-9b7080c3-dade-4406-b904-5d8723ddb3c4 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] 10.222.0.42 "GET /compute/v2.1/servers/f49079c1-1384-4136-b6cf-eadc40fb5aa1" status: 200 len: 1548 microversion: 2.1 time: 0.270471 Jun 06 10:38:56.850678 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 54/115] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:38:56 2022] GET /compute/v2.1/servers/f49079c1-1384-4136-b6cf-eadc40fb5aa1 => generated 1548 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:38:56.856806 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-60608ee6-6be8-48fc-97b4-7965b31cdb3a tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:38:56.857360 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-60608ee6-6be8-48fc-97b4-7965b31cdb3a tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] [instance: f49079c1-1384-4136-b6cf-eadc40fb5aa1] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:38:56.866014 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-60608ee6-6be8-48fc-97b4-7965b31cdb3a tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:38:56.867129 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-60608ee6-6be8-48fc-97b4-7965b31cdb3a tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:38:56.868318 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-60608ee6-6be8-48fc-97b4-7965b31cdb3a tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:38:56.869057 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-60608ee6-6be8-48fc-97b4-7965b31cdb3a tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:38:56.995249 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-60608ee6-6be8-48fc-97b4-7965b31cdb3a tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] 10.222.0.42 "GET /compute/v2.1/servers/f49079c1-1384-4136-b6cf-eadc40fb5aa1/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.144175 Jun 06 10:38:57.000398 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 62/116] 10.222.0.42 () {58 vars in 1274 bytes} [Mon Jun 6 10:38:56 2022] GET /compute/v2.1/servers/f49079c1-1384-4136-b6cf-eadc40fb5aa1/os-interface => generated 284 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 06 10:38:57.819038 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-e2362aa6-2bc6-4928-a7e6-f19dcbdbf54f tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:38:57.819815 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-e2362aa6-2bc6-4928-a7e6-f19dcbdbf54f tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] [instance: 3bdaf03c-d0a2-4d6c-b0f1-ec2d580e63ef] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:38:57.829772 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-e2362aa6-2bc6-4928-a7e6-f19dcbdbf54f tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:38:57.830414 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-e2362aa6-2bc6-4928-a7e6-f19dcbdbf54f tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:38:57.831273 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-e2362aa6-2bc6-4928-a7e6-f19dcbdbf54f tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:38:57.832176 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-e2362aa6-2bc6-4928-a7e6-f19dcbdbf54f tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:38:58.042436 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-e2362aa6-2bc6-4928-a7e6-f19dcbdbf54f tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f269e146c844480c822347c3a38d103b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2b17b61b73b4e6d81dd8ffe9cf311ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:38:58.051861 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-e2362aa6-2bc6-4928-a7e6-f19dcbdbf54f tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] 10.222.0.42 "GET /compute/v2.1/servers/3bdaf03c-d0a2-4d6c-b0f1-ec2d580e63ef" status: 200 len: 1522 microversion: 2.1 time: 0.238707 Jun 06 10:38:58.053180 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 55/117] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:38:57 2022] GET /compute/v2.1/servers/3bdaf03c-d0a2-4d6c-b0f1-ec2d580e63ef => generated 1522 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:38:58.357989 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [req-a03f9a1d-5e52-4026-9aaf-dd758672e90e req-6b856cdd-0c97-495d-be98-321458a1e600 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f49079c1-1384-4136-b6cf-eadc40fb5aa1", "tag": "c68a8af3-23cf-4f43-8b21-304f27c84919"}]} {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 10:38:58.367421 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [req-a03f9a1d-5e52-4026-9aaf-dd758672e90e req-6b856cdd-0c97-495d-be98-321458a1e600 service nova] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:38:58.368056 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [req-a03f9a1d-5e52-4026-9aaf-dd758672e90e req-6b856cdd-0c97-495d-be98-321458a1e600 service nova] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:38:58.384600 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.compute.server_external_events [req-a03f9a1d-5e52-4026-9aaf-dd758672e90e req-6b856cdd-0c97-495d-be98-321458a1e600 service nova] Creating event network-changed:c68a8af3-23cf-4f43-8b21-304f27c84919 for instance f49079c1-1384-4136-b6cf-eadc40fb5aa1 on hv-cinder-84482 Jun 06 10:38:58.391700 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [req-a03f9a1d-5e52-4026-9aaf-dd758672e90e req-6b856cdd-0c97-495d-be98-321458a1e600 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038323 Jun 06 10:38:58.392899 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 63/118] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Jun 6 10:38:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 10:38:59.069898 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-dab886c2-75e8-4bbe-af3c-4159811311c8 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:38:59.071009 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-dab886c2-75e8-4bbe-af3c-4159811311c8 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] [instance: 3bdaf03c-d0a2-4d6c-b0f1-ec2d580e63ef] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:38:59.079409 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-dab886c2-75e8-4bbe-af3c-4159811311c8 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:38:59.081765 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-dab886c2-75e8-4bbe-af3c-4159811311c8 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:38:59.083068 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-dab886c2-75e8-4bbe-af3c-4159811311c8 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:38:59.083840 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-dab886c2-75e8-4bbe-af3c-4159811311c8 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:38:59.115116 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG dbcounter [-] [129350] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 10:38:59.280025 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-dab886c2-75e8-4bbe-af3c-4159811311c8 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f269e146c844480c822347c3a38d103b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2b17b61b73b4e6d81dd8ffe9cf311ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:38:59.289000 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-dab886c2-75e8-4bbe-af3c-4159811311c8 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] 10.222.0.42 "GET /compute/v2.1/servers/3bdaf03c-d0a2-4d6c-b0f1-ec2d580e63ef" status: 200 len: 1522 microversion: 2.1 time: 0.223076 Jun 06 10:38:59.290500 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 56/119] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:38:59 2022] GET /compute/v2.1/servers/3bdaf03c-d0a2-4d6c-b0f1-ec2d580e63ef => generated 1522 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:39:00.307411 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-4d370512-3b55-4eda-9607-af9f164ff6a1 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:39:00.312214 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-4d370512-3b55-4eda-9607-af9f164ff6a1 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] [instance: 3bdaf03c-d0a2-4d6c-b0f1-ec2d580e63ef] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:39:00.319454 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-4d370512-3b55-4eda-9607-af9f164ff6a1 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:39:00.319936 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-4d370512-3b55-4eda-9607-af9f164ff6a1 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:39:00.320702 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-4d370512-3b55-4eda-9607-af9f164ff6a1 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:39:00.321217 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-4d370512-3b55-4eda-9607-af9f164ff6a1 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:39:00.647276 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-2e74415e-d391-4bc0-b1d9-4eccdd7c053c tempest-DeleteServersTestJSON-1512496307 tempest-DeleteServersTestJSON-1512496307-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:39:00.647918 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-2e74415e-d391-4bc0-b1d9-4eccdd7c053c tempest-DeleteServersTestJSON-1512496307 tempest-DeleteServersTestJSON-1512496307-project] [instance: d0c59b89-6051-4967-81c6-1e9559a7d7b6] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:39:00.654879 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-2e74415e-d391-4bc0-b1d9-4eccdd7c053c tempest-DeleteServersTestJSON-1512496307 tempest-DeleteServersTestJSON-1512496307-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:39:00.655328 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-2e74415e-d391-4bc0-b1d9-4eccdd7c053c tempest-DeleteServersTestJSON-1512496307 tempest-DeleteServersTestJSON-1512496307-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:39:00.656116 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-2e74415e-d391-4bc0-b1d9-4eccdd7c053c tempest-DeleteServersTestJSON-1512496307 tempest-DeleteServersTestJSON-1512496307-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:39:00.656544 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-2e74415e-d391-4bc0-b1d9-4eccdd7c053c tempest-DeleteServersTestJSON-1512496307 tempest-DeleteServersTestJSON-1512496307-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:39:00.683487 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-2e74415e-d391-4bc0-b1d9-4eccdd7c053c tempest-DeleteServersTestJSON-1512496307 tempest-DeleteServersTestJSON-1512496307-project] [instance: d0c59b89-6051-4967-81c6-1e9559a7d7b6] Going to try to terminate instance {{(pid=129350) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 06 10:39:00.788812 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-2e74415e-d391-4bc0-b1d9-4eccdd7c053c tempest-DeleteServersTestJSON-1512496307 tempest-DeleteServersTestJSON-1512496307-project] 10.222.0.42 "DELETE /compute/v2.1/servers/d0c59b89-6051-4967-81c6-1e9559a7d7b6" status: 204 len: 0 microversion: 2.1 time: 0.144981 Jun 06 10:39:00.797362 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 57/120] 10.222.0.42 () {58 vars in 1238 bytes} [Mon Jun 6 10:39:00 2022] DELETE /compute/v2.1/servers/d0c59b89-6051-4967-81c6-1e9559a7d7b6 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 06 10:39:00.810259 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-b2a198a2-b36e-4826-854b-bcf85b6d74e2 tempest-DeleteServersTestJSON-1512496307 tempest-DeleteServersTestJSON-1512496307-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:39:00.810969 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-b2a198a2-b36e-4826-854b-bcf85b6d74e2 tempest-DeleteServersTestJSON-1512496307 tempest-DeleteServersTestJSON-1512496307-project] [instance: d0c59b89-6051-4967-81c6-1e9559a7d7b6] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:39:00.817152 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-b2a198a2-b36e-4826-854b-bcf85b6d74e2 tempest-DeleteServersTestJSON-1512496307 tempest-DeleteServersTestJSON-1512496307-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:39:00.817536 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-b2a198a2-b36e-4826-854b-bcf85b6d74e2 tempest-DeleteServersTestJSON-1512496307 tempest-DeleteServersTestJSON-1512496307-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:39:00.818316 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-b2a198a2-b36e-4826-854b-bcf85b6d74e2 tempest-DeleteServersTestJSON-1512496307 tempest-DeleteServersTestJSON-1512496307-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:39:00.818734 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-b2a198a2-b36e-4826-854b-bcf85b6d74e2 tempest-DeleteServersTestJSON-1512496307 tempest-DeleteServersTestJSON-1512496307-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:39:00.872328 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-4d370512-3b55-4eda-9607-af9f164ff6a1 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f269e146c844480c822347c3a38d103b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2b17b61b73b4e6d81dd8ffe9cf311ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:39:00.880414 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-4d370512-3b55-4eda-9607-af9f164ff6a1 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] 10.222.0.42 "GET /compute/v2.1/servers/3bdaf03c-d0a2-4d6c-b0f1-ec2d580e63ef" status: 200 len: 1522 microversion: 2.1 time: 0.577584 Jun 06 10:39:00.880982 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 64/121] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:39:00 2022] GET /compute/v2.1/servers/3bdaf03c-d0a2-4d6c-b0f1-ec2d580e63ef => generated 1522 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:39:01.005278 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-b2a198a2-b36e-4826-854b-bcf85b6d74e2 tempest-DeleteServersTestJSON-1512496307 tempest-DeleteServersTestJSON-1512496307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bbc3cd193444a65861f6e6705fd32cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8486d765afed40dc8795c7ba485d9535', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:39:01.014250 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-b2a198a2-b36e-4826-854b-bcf85b6d74e2 tempest-DeleteServersTestJSON-1512496307 tempest-DeleteServersTestJSON-1512496307-project] 10.222.0.42 "GET /compute/v2.1/servers/d0c59b89-6051-4967-81c6-1e9559a7d7b6" status: 200 len: 1554 microversion: 2.1 time: 0.211300 Jun 06 10:39:01.014813 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 58/122] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:39:00 2022] GET /compute/v2.1/servers/d0c59b89-6051-4967-81c6-1e9559a7d7b6 => generated 1554 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:39:01.897447 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-a1ed53d6-1b1c-44e2-9eec-f49125e514a7 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:39:01.898068 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-a1ed53d6-1b1c-44e2-9eec-f49125e514a7 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] [instance: 3bdaf03c-d0a2-4d6c-b0f1-ec2d580e63ef] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:39:01.904662 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-a1ed53d6-1b1c-44e2-9eec-f49125e514a7 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:39:01.905110 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-a1ed53d6-1b1c-44e2-9eec-f49125e514a7 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:39:01.905881 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-a1ed53d6-1b1c-44e2-9eec-f49125e514a7 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:39:01.906316 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-a1ed53d6-1b1c-44e2-9eec-f49125e514a7 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:39:02.031153 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-2df51f25-37d6-4123-b7af-43b32492a010 tempest-DeleteServersTestJSON-1512496307 tempest-DeleteServersTestJSON-1512496307-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:39:02.031770 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-2df51f25-37d6-4123-b7af-43b32492a010 tempest-DeleteServersTestJSON-1512496307 tempest-DeleteServersTestJSON-1512496307-project] [instance: d0c59b89-6051-4967-81c6-1e9559a7d7b6] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:39:02.032131 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-a1ed53d6-1b1c-44e2-9eec-f49125e514a7 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f269e146c844480c822347c3a38d103b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2b17b61b73b4e6d81dd8ffe9cf311ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:39:02.037841 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-2df51f25-37d6-4123-b7af-43b32492a010 tempest-DeleteServersTestJSON-1512496307 tempest-DeleteServersTestJSON-1512496307-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:39:02.038286 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-2df51f25-37d6-4123-b7af-43b32492a010 tempest-DeleteServersTestJSON-1512496307 tempest-DeleteServersTestJSON-1512496307-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:39:02.039051 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-2df51f25-37d6-4123-b7af-43b32492a010 tempest-DeleteServersTestJSON-1512496307 tempest-DeleteServersTestJSON-1512496307-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:39:02.039487 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-2df51f25-37d6-4123-b7af-43b32492a010 tempest-DeleteServersTestJSON-1512496307 tempest-DeleteServersTestJSON-1512496307-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:39:02.039588 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-a1ed53d6-1b1c-44e2-9eec-f49125e514a7 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] 10.222.0.42 "GET /compute/v2.1/servers/3bdaf03c-d0a2-4d6c-b0f1-ec2d580e63ef" status: 200 len: 1522 microversion: 2.1 time: 0.146308 Jun 06 10:39:02.040173 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 65/123] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:39:01 2022] GET /compute/v2.1/servers/3bdaf03c-d0a2-4d6c-b0f1-ec2d580e63ef => generated 1522 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:39:02.171621 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-2df51f25-37d6-4123-b7af-43b32492a010 tempest-DeleteServersTestJSON-1512496307 tempest-DeleteServersTestJSON-1512496307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bbc3cd193444a65861f6e6705fd32cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8486d765afed40dc8795c7ba485d9535', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:39:02.179465 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-2df51f25-37d6-4123-b7af-43b32492a010 tempest-DeleteServersTestJSON-1512496307 tempest-DeleteServersTestJSON-1512496307-project] 10.222.0.42 "GET /compute/v2.1/servers/d0c59b89-6051-4967-81c6-1e9559a7d7b6" status: 200 len: 1554 microversion: 2.1 time: 0.152306 Jun 06 10:39:02.180053 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 59/124] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:39:02 2022] GET /compute/v2.1/servers/d0c59b89-6051-4967-81c6-1e9559a7d7b6 => generated 1554 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 10:39:03.057070 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-28333357-756c-4cb5-8680-36f6d1bb4c36 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:39:03.057851 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-28333357-756c-4cb5-8680-36f6d1bb4c36 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] [instance: 3bdaf03c-d0a2-4d6c-b0f1-ec2d580e63ef] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:39:03.062266 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG dbcounter [-] [129349] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=3 {{(pid=129349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 10:39:03.065864 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-28333357-756c-4cb5-8680-36f6d1bb4c36 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:39:03.066398 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-28333357-756c-4cb5-8680-36f6d1bb4c36 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:39:03.067163 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-28333357-756c-4cb5-8680-36f6d1bb4c36 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:39:03.067596 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-28333357-756c-4cb5-8680-36f6d1bb4c36 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:39:03.196658 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-b62b17b8-9677-4748-86a5-1d059758ade6 tempest-DeleteServersTestJSON-1512496307 tempest-DeleteServersTestJSON-1512496307-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:39:03.197410 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-b62b17b8-9677-4748-86a5-1d059758ade6 tempest-DeleteServersTestJSON-1512496307 tempest-DeleteServersTestJSON-1512496307-project] [instance: d0c59b89-6051-4967-81c6-1e9559a7d7b6] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:39:03.200984 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG dbcounter [-] [129350] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=129350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 10:39:03.208280 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-b62b17b8-9677-4748-86a5-1d059758ade6 tempest-DeleteServersTestJSON-1512496307 tempest-DeleteServersTestJSON-1512496307-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:39:03.209242 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-b62b17b8-9677-4748-86a5-1d059758ade6 tempest-DeleteServersTestJSON-1512496307 tempest-DeleteServersTestJSON-1512496307-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:39:03.210146 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-b62b17b8-9677-4748-86a5-1d059758ade6 tempest-DeleteServersTestJSON-1512496307 tempest-DeleteServersTestJSON-1512496307-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:39:03.212369 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-b62b17b8-9677-4748-86a5-1d059758ade6 tempest-DeleteServersTestJSON-1512496307 tempest-DeleteServersTestJSON-1512496307-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:39:03.216883 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-28333357-756c-4cb5-8680-36f6d1bb4c36 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f269e146c844480c822347c3a38d103b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2b17b61b73b4e6d81dd8ffe9cf311ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:39:03.225333 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-28333357-756c-4cb5-8680-36f6d1bb4c36 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] 10.222.0.42 "GET /compute/v2.1/servers/3bdaf03c-d0a2-4d6c-b0f1-ec2d580e63ef" status: 200 len: 1522 microversion: 2.1 time: 0.171988 Jun 06 10:39:03.226273 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 66/125] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:39:03 2022] GET /compute/v2.1/servers/3bdaf03c-d0a2-4d6c-b0f1-ec2d580e63ef => generated 1522 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:39:03.354179 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-b62b17b8-9677-4748-86a5-1d059758ade6 tempest-DeleteServersTestJSON-1512496307 tempest-DeleteServersTestJSON-1512496307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bbc3cd193444a65861f6e6705fd32cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8486d765afed40dc8795c7ba485d9535', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:39:03.365092 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-b62b17b8-9677-4748-86a5-1d059758ade6 tempest-DeleteServersTestJSON-1512496307 tempest-DeleteServersTestJSON-1512496307-project] 10.222.0.42 "GET /compute/v2.1/servers/d0c59b89-6051-4967-81c6-1e9559a7d7b6" status: 200 len: 1554 microversion: 2.1 time: 0.172025 Jun 06 10:39:03.365683 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 60/126] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:39:03 2022] GET /compute/v2.1/servers/d0c59b89-6051-4967-81c6-1e9559a7d7b6 => generated 1554 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 10:39:04.245372 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-cb59ef70-0694-4072-8c79-5426cb7a1fd1 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:39:04.246898 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-cb59ef70-0694-4072-8c79-5426cb7a1fd1 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] [instance: 3bdaf03c-d0a2-4d6c-b0f1-ec2d580e63ef] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:39:04.254337 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-cb59ef70-0694-4072-8c79-5426cb7a1fd1 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:39:04.254961 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-cb59ef70-0694-4072-8c79-5426cb7a1fd1 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:39:04.256164 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-cb59ef70-0694-4072-8c79-5426cb7a1fd1 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:39:04.256598 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-cb59ef70-0694-4072-8c79-5426cb7a1fd1 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:39:04.395460 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-70634457-f2e1-41fc-800d-2825f5a23c1f tempest-DeleteServersTestJSON-1512496307 tempest-DeleteServersTestJSON-1512496307-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:39:04.396110 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-70634457-f2e1-41fc-800d-2825f5a23c1f tempest-DeleteServersTestJSON-1512496307 tempest-DeleteServersTestJSON-1512496307-project] [instance: d0c59b89-6051-4967-81c6-1e9559a7d7b6] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:39:04.405883 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-70634457-f2e1-41fc-800d-2825f5a23c1f tempest-DeleteServersTestJSON-1512496307 tempest-DeleteServersTestJSON-1512496307-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:39:04.406554 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-70634457-f2e1-41fc-800d-2825f5a23c1f tempest-DeleteServersTestJSON-1512496307 tempest-DeleteServersTestJSON-1512496307-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:39:04.407536 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-70634457-f2e1-41fc-800d-2825f5a23c1f tempest-DeleteServersTestJSON-1512496307 tempest-DeleteServersTestJSON-1512496307-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:39:04.407984 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-70634457-f2e1-41fc-800d-2825f5a23c1f tempest-DeleteServersTestJSON-1512496307 tempest-DeleteServersTestJSON-1512496307-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:39:04.621475 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-cb59ef70-0694-4072-8c79-5426cb7a1fd1 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f269e146c844480c822347c3a38d103b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2b17b61b73b4e6d81dd8ffe9cf311ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:39:04.629325 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-cb59ef70-0694-4072-8c79-5426cb7a1fd1 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] 10.222.0.42 "GET /compute/v2.1/servers/3bdaf03c-d0a2-4d6c-b0f1-ec2d580e63ef" status: 200 len: 1522 microversion: 2.1 time: 0.389841 Jun 06 10:39:04.629904 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 67/127] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:39:04 2022] GET /compute/v2.1/servers/3bdaf03c-d0a2-4d6c-b0f1-ec2d580e63ef => generated 1522 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:39:04.721937 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-70634457-f2e1-41fc-800d-2825f5a23c1f tempest-DeleteServersTestJSON-1512496307 tempest-DeleteServersTestJSON-1512496307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bbc3cd193444a65861f6e6705fd32cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8486d765afed40dc8795c7ba485d9535', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:39:04.729766 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-70634457-f2e1-41fc-800d-2825f5a23c1f tempest-DeleteServersTestJSON-1512496307 tempest-DeleteServersTestJSON-1512496307-project] 10.222.0.42 "GET /compute/v2.1/servers/d0c59b89-6051-4967-81c6-1e9559a7d7b6" status: 200 len: 1554 microversion: 2.1 time: 0.338350 Jun 06 10:39:04.730333 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 61/128] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:39:04 2022] GET /compute/v2.1/servers/d0c59b89-6051-4967-81c6-1e9559a7d7b6 => generated 1554 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 10:39:05.647710 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-9b77e7f9-6c9b-4fa2-956c-76b82a1f02c3 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:39:05.648430 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-9b77e7f9-6c9b-4fa2-956c-76b82a1f02c3 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] [instance: 3bdaf03c-d0a2-4d6c-b0f1-ec2d580e63ef] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:39:05.656169 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-9b77e7f9-6c9b-4fa2-956c-76b82a1f02c3 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:39:05.656614 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-9b77e7f9-6c9b-4fa2-956c-76b82a1f02c3 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:39:05.657374 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-9b77e7f9-6c9b-4fa2-956c-76b82a1f02c3 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:39:05.657801 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-9b77e7f9-6c9b-4fa2-956c-76b82a1f02c3 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:39:05.746187 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-166e3ebd-7565-47a2-893f-d6a31599ca0c tempest-DeleteServersTestJSON-1512496307 tempest-DeleteServersTestJSON-1512496307-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:39:05.747017 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-166e3ebd-7565-47a2-893f-d6a31599ca0c tempest-DeleteServersTestJSON-1512496307 tempest-DeleteServersTestJSON-1512496307-project] [instance: d0c59b89-6051-4967-81c6-1e9559a7d7b6] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:39:05.753187 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-166e3ebd-7565-47a2-893f-d6a31599ca0c tempest-DeleteServersTestJSON-1512496307 tempest-DeleteServersTestJSON-1512496307-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:39:05.753631 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-166e3ebd-7565-47a2-893f-d6a31599ca0c tempest-DeleteServersTestJSON-1512496307 tempest-DeleteServersTestJSON-1512496307-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:39:05.754389 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-166e3ebd-7565-47a2-893f-d6a31599ca0c tempest-DeleteServersTestJSON-1512496307 tempest-DeleteServersTestJSON-1512496307-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:39:05.754822 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-166e3ebd-7565-47a2-893f-d6a31599ca0c tempest-DeleteServersTestJSON-1512496307 tempest-DeleteServersTestJSON-1512496307-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:39:05.790856 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-9b77e7f9-6c9b-4fa2-956c-76b82a1f02c3 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f269e146c844480c822347c3a38d103b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2b17b61b73b4e6d81dd8ffe9cf311ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:39:05.799016 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-9b77e7f9-6c9b-4fa2-956c-76b82a1f02c3 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] 10.222.0.42 "GET /compute/v2.1/servers/3bdaf03c-d0a2-4d6c-b0f1-ec2d580e63ef" status: 200 len: 1522 microversion: 2.1 time: 0.155658 Jun 06 10:39:05.799581 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 68/129] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:39:05 2022] GET /compute/v2.1/servers/3bdaf03c-d0a2-4d6c-b0f1-ec2d580e63ef => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:39:05.888801 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-166e3ebd-7565-47a2-893f-d6a31599ca0c tempest-DeleteServersTestJSON-1512496307 tempest-DeleteServersTestJSON-1512496307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bbc3cd193444a65861f6e6705fd32cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8486d765afed40dc8795c7ba485d9535', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:39:05.896975 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-166e3ebd-7565-47a2-893f-d6a31599ca0c tempest-DeleteServersTestJSON-1512496307 tempest-DeleteServersTestJSON-1512496307-project] 10.222.0.42 "GET /compute/v2.1/servers/d0c59b89-6051-4967-81c6-1e9559a7d7b6" status: 200 len: 1554 microversion: 2.1 time: 0.154587 Jun 06 10:39:05.897538 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 62/130] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:39:05 2022] GET /compute/v2.1/servers/d0c59b89-6051-4967-81c6-1e9559a7d7b6 => generated 1554 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 10:39:06.817321 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-3c684a91-8c3f-43b9-8b05-9351c974c564 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:39:06.817929 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-3c684a91-8c3f-43b9-8b05-9351c974c564 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] [instance: 3bdaf03c-d0a2-4d6c-b0f1-ec2d580e63ef] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:39:06.824434 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-3c684a91-8c3f-43b9-8b05-9351c974c564 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:39:06.825004 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-3c684a91-8c3f-43b9-8b05-9351c974c564 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:39:06.825910 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-3c684a91-8c3f-43b9-8b05-9351c974c564 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:39:06.826341 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-3c684a91-8c3f-43b9-8b05-9351c974c564 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:39:06.914166 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-6e65fa75-1da1-408e-8d1a-9ca28f5758bd tempest-DeleteServersTestJSON-1512496307 tempest-DeleteServersTestJSON-1512496307-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:39:06.914804 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-6e65fa75-1da1-408e-8d1a-9ca28f5758bd tempest-DeleteServersTestJSON-1512496307 tempest-DeleteServersTestJSON-1512496307-project] [instance: d0c59b89-6051-4967-81c6-1e9559a7d7b6] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:39:06.921392 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-6e65fa75-1da1-408e-8d1a-9ca28f5758bd tempest-DeleteServersTestJSON-1512496307 tempest-DeleteServersTestJSON-1512496307-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:39:06.921838 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-6e65fa75-1da1-408e-8d1a-9ca28f5758bd tempest-DeleteServersTestJSON-1512496307 tempest-DeleteServersTestJSON-1512496307-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:39:06.922598 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-6e65fa75-1da1-408e-8d1a-9ca28f5758bd tempest-DeleteServersTestJSON-1512496307 tempest-DeleteServersTestJSON-1512496307-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:39:06.923033 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-6e65fa75-1da1-408e-8d1a-9ca28f5758bd tempest-DeleteServersTestJSON-1512496307 tempest-DeleteServersTestJSON-1512496307-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:39:06.963822 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-3c684a91-8c3f-43b9-8b05-9351c974c564 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f269e146c844480c822347c3a38d103b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2b17b61b73b4e6d81dd8ffe9cf311ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:39:06.975777 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-3c684a91-8c3f-43b9-8b05-9351c974c564 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] 10.222.0.42 "GET /compute/v2.1/servers/3bdaf03c-d0a2-4d6c-b0f1-ec2d580e63ef" status: 200 len: 1522 microversion: 2.1 time: 0.162159 Jun 06 10:39:06.976429 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 69/131] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:39:06 2022] GET /compute/v2.1/servers/3bdaf03c-d0a2-4d6c-b0f1-ec2d580e63ef => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:39:07.058701 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-6e65fa75-1da1-408e-8d1a-9ca28f5758bd tempest-DeleteServersTestJSON-1512496307 tempest-DeleteServersTestJSON-1512496307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bbc3cd193444a65861f6e6705fd32cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8486d765afed40dc8795c7ba485d9535', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:39:07.067055 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-6e65fa75-1da1-408e-8d1a-9ca28f5758bd tempest-DeleteServersTestJSON-1512496307 tempest-DeleteServersTestJSON-1512496307-project] 10.222.0.42 "GET /compute/v2.1/servers/d0c59b89-6051-4967-81c6-1e9559a7d7b6" status: 200 len: 1554 microversion: 2.1 time: 0.156617 Jun 06 10:39:07.067617 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 63/132] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:39:06 2022] GET /compute/v2.1/servers/d0c59b89-6051-4967-81c6-1e9559a7d7b6 => generated 1554 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 10:39:07.993948 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-0f426d56-2c1d-443e-bcc1-e649d767983f tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:39:07.994733 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-0f426d56-2c1d-443e-bcc1-e649d767983f tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] [instance: 3bdaf03c-d0a2-4d6c-b0f1-ec2d580e63ef] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:39:08.002515 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-0f426d56-2c1d-443e-bcc1-e649d767983f tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:39:08.003074 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-0f426d56-2c1d-443e-bcc1-e649d767983f tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:39:08.003950 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-0f426d56-2c1d-443e-bcc1-e649d767983f tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:39:08.004458 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-0f426d56-2c1d-443e-bcc1-e649d767983f tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:39:08.091175 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-4056bbcc-bc5a-4216-a3f8-65245c9f6694 tempest-DeleteServersTestJSON-1512496307 tempest-DeleteServersTestJSON-1512496307-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:39:08.093814 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-4056bbcc-bc5a-4216-a3f8-65245c9f6694 tempest-DeleteServersTestJSON-1512496307 tempest-DeleteServersTestJSON-1512496307-project] [instance: d0c59b89-6051-4967-81c6-1e9559a7d7b6] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:39:08.104696 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-4056bbcc-bc5a-4216-a3f8-65245c9f6694 tempest-DeleteServersTestJSON-1512496307 tempest-DeleteServersTestJSON-1512496307-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:39:08.105651 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-4056bbcc-bc5a-4216-a3f8-65245c9f6694 tempest-DeleteServersTestJSON-1512496307 tempest-DeleteServersTestJSON-1512496307-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:39:08.107399 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-4056bbcc-bc5a-4216-a3f8-65245c9f6694 tempest-DeleteServersTestJSON-1512496307 tempest-DeleteServersTestJSON-1512496307-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:39:08.108739 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-4056bbcc-bc5a-4216-a3f8-65245c9f6694 tempest-DeleteServersTestJSON-1512496307 tempest-DeleteServersTestJSON-1512496307-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:39:08.468242 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-0f426d56-2c1d-443e-bcc1-e649d767983f tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f269e146c844480c822347c3a38d103b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2b17b61b73b4e6d81dd8ffe9cf311ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:39:08.477745 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-0f426d56-2c1d-443e-bcc1-e649d767983f tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] 10.222.0.42 "GET /compute/v2.1/servers/3bdaf03c-d0a2-4d6c-b0f1-ec2d580e63ef" status: 200 len: 1522 microversion: 2.1 time: 0.488213 Jun 06 10:39:08.488230 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 70/133] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:39:07 2022] GET /compute/v2.1/servers/3bdaf03c-d0a2-4d6c-b0f1-ec2d580e63ef => generated 1522 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:39:08.590966 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [req-147deae6-8eab-4dc3-82d2-ac52448c5196 req-105166b8-c790-441c-a292-ec0e8dae4867 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0c59b89-6051-4967-81c6-1e9559a7d7b6", "name": "network-vif-deleted", "tag": "111884d2-003e-4adc-825c-d66d4bfa0c32"}]} {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 10:39:08.596774 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-4056bbcc-bc5a-4216-a3f8-65245c9f6694 tempest-DeleteServersTestJSON-1512496307 tempest-DeleteServersTestJSON-1512496307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bbc3cd193444a65861f6e6705fd32cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8486d765afed40dc8795c7ba485d9535', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:39:08.602958 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [req-147deae6-8eab-4dc3-82d2-ac52448c5196 req-105166b8-c790-441c-a292-ec0e8dae4867 service nova] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:39:08.603480 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [req-147deae6-8eab-4dc3-82d2-ac52448c5196 req-105166b8-c790-441c-a292-ec0e8dae4867 service nova] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:39:08.605506 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-4056bbcc-bc5a-4216-a3f8-65245c9f6694 tempest-DeleteServersTestJSON-1512496307 tempest-DeleteServersTestJSON-1512496307-project] 10.222.0.42 "GET /compute/v2.1/servers/d0c59b89-6051-4967-81c6-1e9559a7d7b6" status: 200 len: 1554 microversion: 2.1 time: 0.523828 Jun 06 10:39:08.607813 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 64/134] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:39:08 2022] GET /compute/v2.1/servers/d0c59b89-6051-4967-81c6-1e9559a7d7b6 => generated 1554 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:39:08.617140 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.compute.server_external_events [req-147deae6-8eab-4dc3-82d2-ac52448c5196 req-105166b8-c790-441c-a292-ec0e8dae4867 service nova] Creating event network-vif-deleted:111884d2-003e-4adc-825c-d66d4bfa0c32 for instance d0c59b89-6051-4967-81c6-1e9559a7d7b6 on hv-cinder-84482 Jun 06 10:39:08.627530 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [req-147deae6-8eab-4dc3-82d2-ac52448c5196 req-105166b8-c790-441c-a292-ec0e8dae4867 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043230 Jun 06 10:39:08.628235 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 71/135] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Jun 6 10:39:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 06 10:39:09.495524 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-991d365b-09ec-4a74-86a9-62829bc6889a tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:39:09.497567 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-991d365b-09ec-4a74-86a9-62829bc6889a tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] [instance: 3bdaf03c-d0a2-4d6c-b0f1-ec2d580e63ef] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:39:09.503379 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-991d365b-09ec-4a74-86a9-62829bc6889a tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:39:09.504035 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-991d365b-09ec-4a74-86a9-62829bc6889a tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:39:09.504804 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-991d365b-09ec-4a74-86a9-62829bc6889a tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:39:09.505235 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-991d365b-09ec-4a74-86a9-62829bc6889a tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:39:09.624063 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-726d8e34-9077-49ec-912c-8f6829c89fa9 tempest-DeleteServersTestJSON-1512496307 tempest-DeleteServersTestJSON-1512496307-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:39:09.625172 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-726d8e34-9077-49ec-912c-8f6829c89fa9 tempest-DeleteServersTestJSON-1512496307 tempest-DeleteServersTestJSON-1512496307-project] [instance: d0c59b89-6051-4967-81c6-1e9559a7d7b6] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:39:09.633331 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-726d8e34-9077-49ec-912c-8f6829c89fa9 tempest-DeleteServersTestJSON-1512496307 tempest-DeleteServersTestJSON-1512496307-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:39:09.634035 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-726d8e34-9077-49ec-912c-8f6829c89fa9 tempest-DeleteServersTestJSON-1512496307 tempest-DeleteServersTestJSON-1512496307-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:39:09.635249 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-726d8e34-9077-49ec-912c-8f6829c89fa9 tempest-DeleteServersTestJSON-1512496307 tempest-DeleteServersTestJSON-1512496307-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:39:09.635757 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-726d8e34-9077-49ec-912c-8f6829c89fa9 tempest-DeleteServersTestJSON-1512496307 tempest-DeleteServersTestJSON-1512496307-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:39:09.643817 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-991d365b-09ec-4a74-86a9-62829bc6889a tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f269e146c844480c822347c3a38d103b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2b17b61b73b4e6d81dd8ffe9cf311ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:39:09.651868 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-991d365b-09ec-4a74-86a9-62829bc6889a tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] 10.222.0.42 "GET /compute/v2.1/servers/3bdaf03c-d0a2-4d6c-b0f1-ec2d580e63ef" status: 200 len: 1522 microversion: 2.1 time: 0.160509 Jun 06 10:39:09.652442 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 65/136] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:39:09 2022] GET /compute/v2.1/servers/3bdaf03c-d0a2-4d6c-b0f1-ec2d580e63ef => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:39:09.672709 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-726d8e34-9077-49ec-912c-8f6829c89fa9 tempest-DeleteServersTestJSON-1512496307 tempest-DeleteServersTestJSON-1512496307-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:39:09.673157 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-726d8e34-9077-49ec-912c-8f6829c89fa9 tempest-DeleteServersTestJSON-1512496307 tempest-DeleteServersTestJSON-1512496307-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:39:09.673625 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.objects.instance [None req-726d8e34-9077-49ec-912c-8f6829c89fa9 tempest-DeleteServersTestJSON-1512496307 tempest-DeleteServersTestJSON-1512496307-project] Lazy-loading 'fault' on Instance uuid d0c59b89-6051-4967-81c6-1e9559a7d7b6 {{(pid=129349) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 06 10:39:09.721381 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-726d8e34-9077-49ec-912c-8f6829c89fa9 tempest-DeleteServersTestJSON-1512496307 tempest-DeleteServersTestJSON-1512496307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bbc3cd193444a65861f6e6705fd32cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8486d765afed40dc8795c7ba485d9535', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:39:09.728896 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-726d8e34-9077-49ec-912c-8f6829c89fa9 tempest-DeleteServersTestJSON-1512496307 tempest-DeleteServersTestJSON-1512496307-project] 10.222.0.42 "GET /compute/v2.1/servers/d0c59b89-6051-4967-81c6-1e9559a7d7b6" status: 200 len: 1305 microversion: 2.1 time: 0.109908 Jun 06 10:39:09.729621 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 72/137] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:39:09 2022] GET /compute/v2.1/servers/d0c59b89-6051-4967-81c6-1e9559a7d7b6 => generated 1305 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 10:39:10.670936 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-e7d0be61-75e3-4ed2-b75b-38d6ba9ada82 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:39:10.672856 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-e7d0be61-75e3-4ed2-b75b-38d6ba9ada82 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] [instance: 3bdaf03c-d0a2-4d6c-b0f1-ec2d580e63ef] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:39:10.681442 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-e7d0be61-75e3-4ed2-b75b-38d6ba9ada82 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:39:10.685780 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-e7d0be61-75e3-4ed2-b75b-38d6ba9ada82 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:39:10.685780 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-e7d0be61-75e3-4ed2-b75b-38d6ba9ada82 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:39:10.685780 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-e7d0be61-75e3-4ed2-b75b-38d6ba9ada82 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:39:10.748978 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-ef5d7924-3084-4297-b7c7-6c193876af08 tempest-DeleteServersTestJSON-1512496307 tempest-DeleteServersTestJSON-1512496307-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:39:10.750430 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-ef5d7924-3084-4297-b7c7-6c193876af08 tempest-DeleteServersTestJSON-1512496307 tempest-DeleteServersTestJSON-1512496307-project] [instance: d0c59b89-6051-4967-81c6-1e9559a7d7b6] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:39:10.761719 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-ef5d7924-3084-4297-b7c7-6c193876af08 tempest-DeleteServersTestJSON-1512496307 tempest-DeleteServersTestJSON-1512496307-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:39:10.762269 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-ef5d7924-3084-4297-b7c7-6c193876af08 tempest-DeleteServersTestJSON-1512496307 tempest-DeleteServersTestJSON-1512496307-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:39:10.763146 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-ef5d7924-3084-4297-b7c7-6c193876af08 tempest-DeleteServersTestJSON-1512496307 tempest-DeleteServersTestJSON-1512496307-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:39:10.763571 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-ef5d7924-3084-4297-b7c7-6c193876af08 tempest-DeleteServersTestJSON-1512496307 tempest-DeleteServersTestJSON-1512496307-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:39:10.787717 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.wsgi [None req-ef5d7924-3084-4297-b7c7-6c193876af08 tempest-DeleteServersTestJSON-1512496307 tempest-DeleteServersTestJSON-1512496307-project] HTTP exception thrown: Instance d0c59b89-6051-4967-81c6-1e9559a7d7b6 could not be found. Jun 06 10:39:10.800132 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-ef5d7924-3084-4297-b7c7-6c193876af08 tempest-DeleteServersTestJSON-1512496307 tempest-DeleteServersTestJSON-1512496307-project] Request method failure captured: Jun 06 10:39:10.800132 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: request: GET /compute/v2.1/servers/d0c59b89-6051-4967-81c6-1e9559a7d7b6 HTTP/1.1 Jun 06 10:39:10.800132 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: Accept: application/json Jun 06 10:39:10.800132 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: Accept-Encoding: identity Jun 06 10:39:10.800132 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: Connection: close Jun 06 10:39:10.800132 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: Content-Length: 0 Jun 06 10:39:10.800132 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: Content-Type: application/json Jun 06 10:39:10.800132 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: Host: 10.222.0.42 Jun 06 10:39:10.800132 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: Openstack-System-Scope: None Jun 06 10:39:10.800132 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: User-Agent: python-urllib3/1.26.9 Jun 06 10:39:10.800132 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Auth-Token: gAAAAABindkLNod-16Qxiu09dI7Wyt4ydjkzpQUc2kxEAdPqZ6qP5MtK9CeY4nwyM1rx5GdhIqydJUGsuV2Yo0AmVI-75YSY9I2wq1bV0LS1J6p5DpWbHvZDd6B-vVDRrocS1nTR1yUCnSXeOXA1yGtjh-oIfrBIJV9SKVR9ZJYr71F5Uq5DkbA Jun 06 10:39:10.800132 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Domain-Id: None Jun 06 10:39:10.800132 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Domain-Name: None Jun 06 10:39:10.800132 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Identity-Status: Confirmed Jun 06 10:39:10.800132 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Is-Admin-Project: True Jun 06 10:39:10.800132 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Project-Domain-Id: default Jun 06 10:39:10.800132 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Project-Domain-Name: Default Jun 06 10:39:10.800132 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Project-Id: 8486d765afed40dc8795c7ba485d9535 Jun 06 10:39:10.800132 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Project-Name: tempest-DeleteServersTestJSON-1512496307 Jun 06 10:39:10.800132 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Role: member,reader Jun 06 10:39:10.800132 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Roles: member,reader Jun 06 10:39:10.801606 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/8486d765afed40dc8795c7ba485d9535"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/8486d765afed40dc8795c7ba485d9535"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/8486d765afed40dc8795c7ba485d9535"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_8486d765afed40dc8795c7ba485d9535", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Jun 06 10:39:10.801606 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Tenant: tempest-DeleteServersTestJSON-1512496307 Jun 06 10:39:10.801606 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Tenant-Id: 8486d765afed40dc8795c7ba485d9535 Jun 06 10:39:10.801606 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Tenant-Name: tempest-DeleteServersTestJSON-1512496307 Jun 06 10:39:10.801606 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-User: tempest-DeleteServersTestJSON-1512496307-project Jun 06 10:39:10.801606 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-User-Domain-Id: default Jun 06 10:39:10.801606 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-User-Domain-Name: Default Jun 06 10:39:10.801606 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-User-Id: 3bbc3cd193444a65861f6e6705fd32cf Jun 06 10:39:10.801606 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-User-Name: tempest-DeleteServersTestJSON-1512496307-project Jun 06 10:39:10.801606 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: method: > Jun 06 10:39:10.801606 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: exception: Instance d0c59b89-6051-4967-81c6-1e9559a7d7b6 could not be found. Jun 06 10:39:10.801606 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: action_args: {'id': 'd0c59b89-6051-4967-81c6-1e9559a7d7b6'} Jun 06 10:39:10.802408 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 10:39:10.802408 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 10:39:10.802408 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 06 10:39:10.802408 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 06 10:39:10.802408 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 06 10:39:10.802408 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 06 10:39:10.802408 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 06 10:39:10.802408 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 06 10:39:10.802408 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 06 10:39:10.802408 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 06 10:39:10.802408 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d0c59b89-6051-4967-81c6-1e9559a7d7b6 could not be found. Jun 06 10:39:10.802408 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Jun 06 10:39:10.802408 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 10:39:10.802408 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Jun 06 10:39:10.802408 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 10:39:10.802408 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 10:39:10.802408 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 10:39:10.802408 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 10:39:10.802408 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 10:39:10.802408 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 10:39:10.803716 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 10:39:10.803716 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 06 10:39:10.803716 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 06 10:39:10.803716 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 06 10:39:10.803716 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 06 10:39:10.803716 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 06 10:39:10.803716 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 06 10:39:10.803716 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d0c59b89-6051-4967-81c6-1e9559a7d7b6 could not be found. Jun 06 10:39:10.803716 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Jun 06 10:39:10.803716 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 10:39:10.803716 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Jun 06 10:39:10.803716 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 10:39:10.803716 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 10:39:10.803716 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 10:39:10.803716 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 10:39:10.803716 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 10:39:10.803716 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d0c59b89-6051-4967-81c6-1e9559a7d7b6 could not be found. Jun 06 10:39:10.803716 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Jun 06 10:39:10.806055 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-ef5d7924-3084-4297-b7c7-6c193876af08 tempest-DeleteServersTestJSON-1512496307 tempest-DeleteServersTestJSON-1512496307-project] Returning 404 to user: Instance d0c59b89-6051-4967-81c6-1e9559a7d7b6 could not be found. {{(pid=129349) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 10:39:10.806055 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-ef5d7924-3084-4297-b7c7-6c193876af08 tempest-DeleteServersTestJSON-1512496307 tempest-DeleteServersTestJSON-1512496307-project] 10.222.0.42 "GET /compute/v2.1/servers/d0c59b89-6051-4967-81c6-1e9559a7d7b6" status: 404 len: 111 microversion: 2.1 time: 0.053895 Jun 06 10:39:10.806055 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 73/138] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:39:10 2022] GET /compute/v2.1/servers/d0c59b89-6051-4967-81c6-1e9559a7d7b6 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 06 10:39:10.870998 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-e7d0be61-75e3-4ed2-b75b-38d6ba9ada82 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f269e146c844480c822347c3a38d103b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2b17b61b73b4e6d81dd8ffe9cf311ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:39:10.880794 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-e7d0be61-75e3-4ed2-b75b-38d6ba9ada82 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] 10.222.0.42 "GET /compute/v2.1/servers/3bdaf03c-d0a2-4d6c-b0f1-ec2d580e63ef" status: 200 len: 1522 microversion: 2.1 time: 0.215439 Jun 06 10:39:10.881615 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 66/139] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:39:10 2022] GET /compute/v2.1/servers/3bdaf03c-d0a2-4d6c-b0f1-ec2d580e63ef => generated 1522 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:39:10.936919 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-16535656-3e4e-45cc-a910-e952437963e0 tempest-DeleteServersTestJSON-1512496307 tempest-DeleteServersTestJSON-1512496307-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:39:10.937874 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-16535656-3e4e-45cc-a910-e952437963e0 tempest-DeleteServersTestJSON-1512496307 tempest-DeleteServersTestJSON-1512496307-project] [instance: d0c59b89-6051-4967-81c6-1e9559a7d7b6] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:39:10.945123 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-16535656-3e4e-45cc-a910-e952437963e0 tempest-DeleteServersTestJSON-1512496307 tempest-DeleteServersTestJSON-1512496307-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:39:10.945574 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-16535656-3e4e-45cc-a910-e952437963e0 tempest-DeleteServersTestJSON-1512496307 tempest-DeleteServersTestJSON-1512496307-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:39:10.946344 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-16535656-3e4e-45cc-a910-e952437963e0 tempest-DeleteServersTestJSON-1512496307 tempest-DeleteServersTestJSON-1512496307-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:39:10.946835 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-16535656-3e4e-45cc-a910-e952437963e0 tempest-DeleteServersTestJSON-1512496307 tempest-DeleteServersTestJSON-1512496307-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:39:10.962368 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.wsgi [None req-16535656-3e4e-45cc-a910-e952437963e0 tempest-DeleteServersTestJSON-1512496307 tempest-DeleteServersTestJSON-1512496307-project] HTTP exception thrown: Instance d0c59b89-6051-4967-81c6-1e9559a7d7b6 could not be found. Jun 06 10:39:10.964040 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-16535656-3e4e-45cc-a910-e952437963e0 tempest-DeleteServersTestJSON-1512496307 tempest-DeleteServersTestJSON-1512496307-project] Request method failure captured: Jun 06 10:39:10.964040 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: request: GET /compute/v2.1/servers/d0c59b89-6051-4967-81c6-1e9559a7d7b6/os-volume_attachments HTTP/1.1 Jun 06 10:39:10.964040 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: Accept: application/json Jun 06 10:39:10.964040 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: Accept-Encoding: identity Jun 06 10:39:10.964040 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: Connection: close Jun 06 10:39:10.964040 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: Content-Length: 0 Jun 06 10:39:10.964040 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: Content-Type: application/json Jun 06 10:39:10.964040 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: Host: 10.222.0.42 Jun 06 10:39:10.964040 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: Openstack-System-Scope: None Jun 06 10:39:10.964040 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: User-Agent: python-urllib3/1.26.9 Jun 06 10:39:10.964040 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Auth-Token: gAAAAABindkLNod-16Qxiu09dI7Wyt4ydjkzpQUc2kxEAdPqZ6qP5MtK9CeY4nwyM1rx5GdhIqydJUGsuV2Yo0AmVI-75YSY9I2wq1bV0LS1J6p5DpWbHvZDd6B-vVDRrocS1nTR1yUCnSXeOXA1yGtjh-oIfrBIJV9SKVR9ZJYr71F5Uq5DkbA Jun 06 10:39:10.964040 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Domain-Id: None Jun 06 10:39:10.964040 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Domain-Name: None Jun 06 10:39:10.964040 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Identity-Status: Confirmed Jun 06 10:39:10.964040 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Is-Admin-Project: True Jun 06 10:39:10.964040 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Project-Domain-Id: default Jun 06 10:39:10.964040 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Project-Domain-Name: Default Jun 06 10:39:10.964040 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Project-Id: 8486d765afed40dc8795c7ba485d9535 Jun 06 10:39:10.964040 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Project-Name: tempest-DeleteServersTestJSON-1512496307 Jun 06 10:39:10.964040 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Role: member,reader Jun 06 10:39:10.964040 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Roles: member,reader Jun 06 10:39:10.966042 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/8486d765afed40dc8795c7ba485d9535"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/8486d765afed40dc8795c7ba485d9535"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/8486d765afed40dc8795c7ba485d9535"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_8486d765afed40dc8795c7ba485d9535", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Jun 06 10:39:10.966042 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Tenant: tempest-DeleteServersTestJSON-1512496307 Jun 06 10:39:10.966042 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Tenant-Id: 8486d765afed40dc8795c7ba485d9535 Jun 06 10:39:10.966042 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Tenant-Name: tempest-DeleteServersTestJSON-1512496307 Jun 06 10:39:10.966042 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-User: tempest-DeleteServersTestJSON-1512496307-project Jun 06 10:39:10.966042 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-User-Domain-Id: default Jun 06 10:39:10.966042 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-User-Domain-Name: Default Jun 06 10:39:10.966042 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-User-Id: 3bbc3cd193444a65861f6e6705fd32cf Jun 06 10:39:10.966042 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-User-Name: tempest-DeleteServersTestJSON-1512496307-project Jun 06 10:39:10.966042 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: method: > Jun 06 10:39:10.966042 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: exception: Instance d0c59b89-6051-4967-81c6-1e9559a7d7b6 could not be found. Jun 06 10:39:10.966042 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: action_args: {'server_id': 'd0c59b89-6051-4967-81c6-1e9559a7d7b6'} Jun 06 10:39:10.966837 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 10:39:10.966837 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 10:39:10.966837 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 06 10:39:10.966837 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 06 10:39:10.966837 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 06 10:39:10.966837 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 06 10:39:10.966837 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 06 10:39:10.966837 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 06 10:39:10.966837 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 06 10:39:10.966837 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 06 10:39:10.966837 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d0c59b89-6051-4967-81c6-1e9559a7d7b6 could not be found. Jun 06 10:39:10.966837 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Jun 06 10:39:10.966837 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 10:39:10.966837 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Jun 06 10:39:10.966837 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 10:39:10.966837 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 10:39:10.966837 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 10:39:10.966837 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 10:39:10.966837 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 10:39:10.966837 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 10:39:10.968112 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 10:39:10.968112 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 06 10:39:10.968112 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 06 10:39:10.968112 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 06 10:39:10.968112 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 06 10:39:10.968112 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jun 06 10:39:10.968112 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jun 06 10:39:10.968112 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 06 10:39:10.968112 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 06 10:39:10.968112 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d0c59b89-6051-4967-81c6-1e9559a7d7b6 could not be found. Jun 06 10:39:10.968112 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Jun 06 10:39:10.968112 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 10:39:10.968112 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Jun 06 10:39:10.968112 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 10:39:10.968112 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 10:39:10.968112 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 10:39:10.968112 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 10:39:10.968112 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 10:39:10.968112 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d0c59b89-6051-4967-81c6-1e9559a7d7b6 could not be found. Jun 06 10:39:10.968112 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Jun 06 10:39:10.969365 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-16535656-3e4e-45cc-a910-e952437963e0 tempest-DeleteServersTestJSON-1512496307 tempest-DeleteServersTestJSON-1512496307-project] Returning 404 to user: Instance d0c59b89-6051-4967-81c6-1e9559a7d7b6 could not be found. {{(pid=129349) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 10:39:10.969365 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-16535656-3e4e-45cc-a910-e952437963e0 tempest-DeleteServersTestJSON-1512496307 tempest-DeleteServersTestJSON-1512496307-project] 10.222.0.42 "GET /compute/v2.1/servers/d0c59b89-6051-4967-81c6-1e9559a7d7b6/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.034432 Jun 06 10:39:10.969365 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 74/140] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jun 6 10:39:10 2022] GET /compute/v2.1/servers/d0c59b89-6051-4967-81c6-1e9559a7d7b6/os-volume_attachments => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 06 10:39:11.898252 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-331a1668-20b5-4d8c-abc8-a30df6e34cbd tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:39:11.898874 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-331a1668-20b5-4d8c-abc8-a30df6e34cbd tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] [instance: 3bdaf03c-d0a2-4d6c-b0f1-ec2d580e63ef] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:39:11.905398 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-331a1668-20b5-4d8c-abc8-a30df6e34cbd tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:39:11.905921 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-331a1668-20b5-4d8c-abc8-a30df6e34cbd tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:39:11.907093 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-331a1668-20b5-4d8c-abc8-a30df6e34cbd tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:39:11.907477 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-331a1668-20b5-4d8c-abc8-a30df6e34cbd tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:39:12.063955 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-331a1668-20b5-4d8c-abc8-a30df6e34cbd tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f269e146c844480c822347c3a38d103b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2b17b61b73b4e6d81dd8ffe9cf311ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:39:12.074434 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-331a1668-20b5-4d8c-abc8-a30df6e34cbd tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] 10.222.0.42 "GET /compute/v2.1/servers/3bdaf03c-d0a2-4d6c-b0f1-ec2d580e63ef" status: 200 len: 1522 microversion: 2.1 time: 0.180277 Jun 06 10:39:12.075661 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 67/141] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:39:11 2022] GET /compute/v2.1/servers/3bdaf03c-d0a2-4d6c-b0f1-ec2d580e63ef => generated 1522 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:39:12.170020 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-6f8e1b03-c5ed-41e8-b7a9-9ad15ca93c02 tempest-DeleteServersTestJSON-1512496307 tempest-DeleteServersTestJSON-1512496307-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:39:12.171240 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-6f8e1b03-c5ed-41e8-b7a9-9ad15ca93c02 tempest-DeleteServersTestJSON-1512496307 tempest-DeleteServersTestJSON-1512496307-project] [instance: d0c59b89-6051-4967-81c6-1e9559a7d7b6] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:39:12.178967 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-6f8e1b03-c5ed-41e8-b7a9-9ad15ca93c02 tempest-DeleteServersTestJSON-1512496307 tempest-DeleteServersTestJSON-1512496307-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:39:12.179766 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-6f8e1b03-c5ed-41e8-b7a9-9ad15ca93c02 tempest-DeleteServersTestJSON-1512496307 tempest-DeleteServersTestJSON-1512496307-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:39:12.180809 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-6f8e1b03-c5ed-41e8-b7a9-9ad15ca93c02 tempest-DeleteServersTestJSON-1512496307 tempest-DeleteServersTestJSON-1512496307-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:39:12.181437 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-6f8e1b03-c5ed-41e8-b7a9-9ad15ca93c02 tempest-DeleteServersTestJSON-1512496307 tempest-DeleteServersTestJSON-1512496307-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:39:12.199919 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.wsgi [None req-6f8e1b03-c5ed-41e8-b7a9-9ad15ca93c02 tempest-DeleteServersTestJSON-1512496307 tempest-DeleteServersTestJSON-1512496307-project] HTTP exception thrown: Instance d0c59b89-6051-4967-81c6-1e9559a7d7b6 could not be found. Jun 06 10:39:12.202080 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-6f8e1b03-c5ed-41e8-b7a9-9ad15ca93c02 tempest-DeleteServersTestJSON-1512496307 tempest-DeleteServersTestJSON-1512496307-project] Request method failure captured: Jun 06 10:39:12.202080 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: request: DELETE /compute/v2.1/servers/d0c59b89-6051-4967-81c6-1e9559a7d7b6 HTTP/1.1 Jun 06 10:39:12.202080 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: Accept: application/json Jun 06 10:39:12.202080 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: Accept-Encoding: identity Jun 06 10:39:12.202080 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: Connection: close Jun 06 10:39:12.202080 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: Content-Length: 0 Jun 06 10:39:12.202080 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: Content-Type: application/json Jun 06 10:39:12.202080 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: Host: 10.222.0.42 Jun 06 10:39:12.202080 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: Openstack-System-Scope: None Jun 06 10:39:12.202080 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: User-Agent: python-urllib3/1.26.9 Jun 06 10:39:12.202080 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Auth-Token: gAAAAABindkLNod-16Qxiu09dI7Wyt4ydjkzpQUc2kxEAdPqZ6qP5MtK9CeY4nwyM1rx5GdhIqydJUGsuV2Yo0AmVI-75YSY9I2wq1bV0LS1J6p5DpWbHvZDd6B-vVDRrocS1nTR1yUCnSXeOXA1yGtjh-oIfrBIJV9SKVR9ZJYr71F5Uq5DkbA Jun 06 10:39:12.202080 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Domain-Id: None Jun 06 10:39:12.202080 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Domain-Name: None Jun 06 10:39:12.202080 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Identity-Status: Confirmed Jun 06 10:39:12.202080 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Is-Admin-Project: True Jun 06 10:39:12.202080 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Project-Domain-Id: default Jun 06 10:39:12.202080 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Project-Domain-Name: Default Jun 06 10:39:12.202080 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Project-Id: 8486d765afed40dc8795c7ba485d9535 Jun 06 10:39:12.202080 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Project-Name: tempest-DeleteServersTestJSON-1512496307 Jun 06 10:39:12.202080 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Role: member,reader Jun 06 10:39:12.202080 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Roles: member,reader Jun 06 10:39:12.203294 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/8486d765afed40dc8795c7ba485d9535"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/8486d765afed40dc8795c7ba485d9535"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/8486d765afed40dc8795c7ba485d9535"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_8486d765afed40dc8795c7ba485d9535", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Jun 06 10:39:12.203294 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Tenant: tempest-DeleteServersTestJSON-1512496307 Jun 06 10:39:12.203294 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Tenant-Id: 8486d765afed40dc8795c7ba485d9535 Jun 06 10:39:12.203294 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Tenant-Name: tempest-DeleteServersTestJSON-1512496307 Jun 06 10:39:12.203294 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-User: tempest-DeleteServersTestJSON-1512496307-project Jun 06 10:39:12.203294 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-User-Domain-Id: default Jun 06 10:39:12.203294 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-User-Domain-Name: Default Jun 06 10:39:12.203294 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-User-Id: 3bbc3cd193444a65861f6e6705fd32cf Jun 06 10:39:12.203294 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-User-Name: tempest-DeleteServersTestJSON-1512496307-project Jun 06 10:39:12.203294 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: method: > Jun 06 10:39:12.203294 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: exception: Instance d0c59b89-6051-4967-81c6-1e9559a7d7b6 could not be found. Jun 06 10:39:12.203294 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: action_args: {'id': 'd0c59b89-6051-4967-81c6-1e9559a7d7b6'} Jun 06 10:39:12.204031 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 10:39:12.204031 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 10:39:12.204031 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 06 10:39:12.204031 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 06 10:39:12.204031 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 06 10:39:12.204031 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 06 10:39:12.204031 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 06 10:39:12.204031 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 06 10:39:12.204031 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 06 10:39:12.204031 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 06 10:39:12.204031 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d0c59b89-6051-4967-81c6-1e9559a7d7b6 could not be found. Jun 06 10:39:12.204031 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Jun 06 10:39:12.204031 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 10:39:12.204031 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Jun 06 10:39:12.204031 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 10:39:12.204031 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 10:39:12.204031 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 10:39:12.204031 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 10:39:12.204031 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 10:39:12.204031 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 10:39:12.205086 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 10:39:12.205086 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 06 10:39:12.205086 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 06 10:39:12.205086 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 06 10:39:12.205086 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 06 10:39:12.205086 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 06 10:39:12.205086 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 06 10:39:12.205086 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 06 10:39:12.205086 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 06 10:39:12.205086 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d0c59b89-6051-4967-81c6-1e9559a7d7b6 could not be found. Jun 06 10:39:12.205086 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Jun 06 10:39:12.205086 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 10:39:12.205086 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Jun 06 10:39:12.205086 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 10:39:12.205086 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 10:39:12.205086 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 10:39:12.205086 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 10:39:12.205086 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 10:39:12.205086 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d0c59b89-6051-4967-81c6-1e9559a7d7b6 could not be found. Jun 06 10:39:12.205086 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Jun 06 10:39:12.206281 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-6f8e1b03-c5ed-41e8-b7a9-9ad15ca93c02 tempest-DeleteServersTestJSON-1512496307 tempest-DeleteServersTestJSON-1512496307-project] Returning 404 to user: Instance d0c59b89-6051-4967-81c6-1e9559a7d7b6 could not be found. {{(pid=129349) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 10:39:12.206281 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-6f8e1b03-c5ed-41e8-b7a9-9ad15ca93c02 tempest-DeleteServersTestJSON-1512496307 tempest-DeleteServersTestJSON-1512496307-project] 10.222.0.42 "DELETE /compute/v2.1/servers/d0c59b89-6051-4967-81c6-1e9559a7d7b6" status: 404 len: 111 microversion: 2.1 time: 0.039500 Jun 06 10:39:12.206281 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 75/142] 10.222.0.42 () {58 vars in 1238 bytes} [Mon Jun 6 10:39:12 2022] DELETE /compute/v2.1/servers/d0c59b89-6051-4967-81c6-1e9559a7d7b6 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 06 10:39:12.212826 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-e30d58a6-6442-4a17-b840-7611cfadff72 tempest-DeleteServersTestJSON-1512496307 tempest-DeleteServersTestJSON-1512496307-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:39:12.213617 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-e30d58a6-6442-4a17-b840-7611cfadff72 tempest-DeleteServersTestJSON-1512496307 tempest-DeleteServersTestJSON-1512496307-project] [instance: d0c59b89-6051-4967-81c6-1e9559a7d7b6] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:39:12.223578 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-e30d58a6-6442-4a17-b840-7611cfadff72 tempest-DeleteServersTestJSON-1512496307 tempest-DeleteServersTestJSON-1512496307-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:39:12.224638 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-e30d58a6-6442-4a17-b840-7611cfadff72 tempest-DeleteServersTestJSON-1512496307 tempest-DeleteServersTestJSON-1512496307-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:39:12.225685 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-e30d58a6-6442-4a17-b840-7611cfadff72 tempest-DeleteServersTestJSON-1512496307 tempest-DeleteServersTestJSON-1512496307-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:39:12.226611 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-e30d58a6-6442-4a17-b840-7611cfadff72 tempest-DeleteServersTestJSON-1512496307 tempest-DeleteServersTestJSON-1512496307-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:39:12.252694 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.wsgi [None req-e30d58a6-6442-4a17-b840-7611cfadff72 tempest-DeleteServersTestJSON-1512496307 tempest-DeleteServersTestJSON-1512496307-project] HTTP exception thrown: Instance d0c59b89-6051-4967-81c6-1e9559a7d7b6 could not be found. Jun 06 10:39:12.261556 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-e30d58a6-6442-4a17-b840-7611cfadff72 tempest-DeleteServersTestJSON-1512496307 tempest-DeleteServersTestJSON-1512496307-project] Request method failure captured: Jun 06 10:39:12.261556 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: request: GET /compute/v2.1/servers/d0c59b89-6051-4967-81c6-1e9559a7d7b6 HTTP/1.1 Jun 06 10:39:12.261556 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: Accept: application/json Jun 06 10:39:12.261556 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: Accept-Encoding: identity Jun 06 10:39:12.261556 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: Connection: close Jun 06 10:39:12.261556 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: Content-Length: 0 Jun 06 10:39:12.261556 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: Content-Type: application/json Jun 06 10:39:12.261556 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: Host: 10.222.0.42 Jun 06 10:39:12.261556 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: Openstack-System-Scope: None Jun 06 10:39:12.261556 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: User-Agent: python-urllib3/1.26.9 Jun 06 10:39:12.261556 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Auth-Token: gAAAAABindkLNod-16Qxiu09dI7Wyt4ydjkzpQUc2kxEAdPqZ6qP5MtK9CeY4nwyM1rx5GdhIqydJUGsuV2Yo0AmVI-75YSY9I2wq1bV0LS1J6p5DpWbHvZDd6B-vVDRrocS1nTR1yUCnSXeOXA1yGtjh-oIfrBIJV9SKVR9ZJYr71F5Uq5DkbA Jun 06 10:39:12.261556 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Domain-Id: None Jun 06 10:39:12.261556 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Domain-Name: None Jun 06 10:39:12.261556 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Identity-Status: Confirmed Jun 06 10:39:12.261556 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Is-Admin-Project: True Jun 06 10:39:12.261556 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Project-Domain-Id: default Jun 06 10:39:12.261556 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Project-Domain-Name: Default Jun 06 10:39:12.261556 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Project-Id: 8486d765afed40dc8795c7ba485d9535 Jun 06 10:39:12.261556 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Project-Name: tempest-DeleteServersTestJSON-1512496307 Jun 06 10:39:12.261556 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Role: member,reader Jun 06 10:39:12.261556 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Roles: member,reader Jun 06 10:39:12.263224 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/8486d765afed40dc8795c7ba485d9535"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/8486d765afed40dc8795c7ba485d9535"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/8486d765afed40dc8795c7ba485d9535"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_8486d765afed40dc8795c7ba485d9535", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Jun 06 10:39:12.263224 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Tenant: tempest-DeleteServersTestJSON-1512496307 Jun 06 10:39:12.263224 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Tenant-Id: 8486d765afed40dc8795c7ba485d9535 Jun 06 10:39:12.263224 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Tenant-Name: tempest-DeleteServersTestJSON-1512496307 Jun 06 10:39:12.263224 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-User: tempest-DeleteServersTestJSON-1512496307-project Jun 06 10:39:12.263224 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-User-Domain-Id: default Jun 06 10:39:12.263224 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-User-Domain-Name: Default Jun 06 10:39:12.263224 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-User-Id: 3bbc3cd193444a65861f6e6705fd32cf Jun 06 10:39:12.263224 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-User-Name: tempest-DeleteServersTestJSON-1512496307-project Jun 06 10:39:12.263224 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: method: > Jun 06 10:39:12.263224 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: exception: Instance d0c59b89-6051-4967-81c6-1e9559a7d7b6 could not be found. Jun 06 10:39:12.263224 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: action_args: {'id': 'd0c59b89-6051-4967-81c6-1e9559a7d7b6'} Jun 06 10:39:12.264032 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 10:39:12.264032 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 10:39:12.264032 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 06 10:39:12.264032 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 06 10:39:12.264032 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 06 10:39:12.264032 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 06 10:39:12.264032 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 06 10:39:12.264032 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 06 10:39:12.264032 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 06 10:39:12.264032 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 06 10:39:12.264032 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d0c59b89-6051-4967-81c6-1e9559a7d7b6 could not be found. Jun 06 10:39:12.264032 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi Jun 06 10:39:12.264032 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 10:39:12.264032 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi Jun 06 10:39:12.264032 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 10:39:12.264032 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 10:39:12.264032 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 10:39:12.264032 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 10:39:12.264032 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 10:39:12.264032 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 10:39:12.265097 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 10:39:12.265097 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 06 10:39:12.265097 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 06 10:39:12.265097 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 06 10:39:12.265097 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 06 10:39:12.265097 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 06 10:39:12.265097 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 06 10:39:12.265097 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d0c59b89-6051-4967-81c6-1e9559a7d7b6 could not be found. Jun 06 10:39:12.265097 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi Jun 06 10:39:12.265097 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 10:39:12.265097 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi Jun 06 10:39:12.265097 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 10:39:12.265097 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 10:39:12.265097 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 10:39:12.265097 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 10:39:12.265097 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 10:39:12.265097 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d0c59b89-6051-4967-81c6-1e9559a7d7b6 could not be found. Jun 06 10:39:12.265097 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi Jun 06 10:39:12.266043 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-e30d58a6-6442-4a17-b840-7611cfadff72 tempest-DeleteServersTestJSON-1512496307 tempest-DeleteServersTestJSON-1512496307-project] Returning 404 to user: Instance d0c59b89-6051-4967-81c6-1e9559a7d7b6 could not be found. {{(pid=129350) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 10:39:12.266043 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-e30d58a6-6442-4a17-b840-7611cfadff72 tempest-DeleteServersTestJSON-1512496307 tempest-DeleteServersTestJSON-1512496307-project] 10.222.0.42 "GET /compute/v2.1/servers/d0c59b89-6051-4967-81c6-1e9559a7d7b6" status: 404 len: 111 microversion: 2.1 time: 0.054674 Jun 06 10:39:12.267914 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 68/143] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:39:12 2022] GET /compute/v2.1/servers/d0c59b89-6051-4967-81c6-1e9559a7d7b6 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 06 10:39:13.096512 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-cd16e60a-c7c6-4343-b3f4-97f1ba1ab2b5 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:39:13.097239 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-cd16e60a-c7c6-4343-b3f4-97f1ba1ab2b5 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] [instance: 3bdaf03c-d0a2-4d6c-b0f1-ec2d580e63ef] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:39:13.105953 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-cd16e60a-c7c6-4343-b3f4-97f1ba1ab2b5 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:39:13.106518 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-cd16e60a-c7c6-4343-b3f4-97f1ba1ab2b5 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:39:13.107590 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-cd16e60a-c7c6-4343-b3f4-97f1ba1ab2b5 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:39:13.108491 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-cd16e60a-c7c6-4343-b3f4-97f1ba1ab2b5 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:39:13.283046 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-cd16e60a-c7c6-4343-b3f4-97f1ba1ab2b5 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f269e146c844480c822347c3a38d103b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2b17b61b73b4e6d81dd8ffe9cf311ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:39:13.291581 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-cd16e60a-c7c6-4343-b3f4-97f1ba1ab2b5 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] 10.222.0.42 "GET /compute/v2.1/servers/3bdaf03c-d0a2-4d6c-b0f1-ec2d580e63ef" status: 200 len: 1522 microversion: 2.1 time: 0.201968 Jun 06 10:39:13.292575 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 76/144] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:39:13 2022] GET /compute/v2.1/servers/3bdaf03c-d0a2-4d6c-b0f1-ec2d580e63ef => generated 1522 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:39:14.309313 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-bddf96d1-69c1-4fae-a945-50d0ca2fbb52 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:39:14.309982 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-bddf96d1-69c1-4fae-a945-50d0ca2fbb52 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] [instance: 3bdaf03c-d0a2-4d6c-b0f1-ec2d580e63ef] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:39:14.315945 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-bddf96d1-69c1-4fae-a945-50d0ca2fbb52 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:39:14.316638 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-bddf96d1-69c1-4fae-a945-50d0ca2fbb52 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:39:14.317643 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-bddf96d1-69c1-4fae-a945-50d0ca2fbb52 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:39:14.318304 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-bddf96d1-69c1-4fae-a945-50d0ca2fbb52 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:39:14.542397 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-bddf96d1-69c1-4fae-a945-50d0ca2fbb52 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f269e146c844480c822347c3a38d103b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2b17b61b73b4e6d81dd8ffe9cf311ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:39:14.554227 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-bddf96d1-69c1-4fae-a945-50d0ca2fbb52 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] 10.222.0.42 "GET /compute/v2.1/servers/3bdaf03c-d0a2-4d6c-b0f1-ec2d580e63ef" status: 200 len: 1522 microversion: 2.1 time: 0.248906 Jun 06 10:39:14.555647 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 69/145] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:39:14 2022] GET /compute/v2.1/servers/3bdaf03c-d0a2-4d6c-b0f1-ec2d580e63ef => generated 1522 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:39:15.572663 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-4ddf99ed-5f01-443a-96f1-932e85e2b3bd tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:39:15.573279 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-4ddf99ed-5f01-443a-96f1-932e85e2b3bd tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] [instance: 3bdaf03c-d0a2-4d6c-b0f1-ec2d580e63ef] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:39:15.579693 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-4ddf99ed-5f01-443a-96f1-932e85e2b3bd tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:39:15.580177 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-4ddf99ed-5f01-443a-96f1-932e85e2b3bd tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:39:15.580950 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-4ddf99ed-5f01-443a-96f1-932e85e2b3bd tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:39:15.581385 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-4ddf99ed-5f01-443a-96f1-932e85e2b3bd tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:39:15.732956 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-4ddf99ed-5f01-443a-96f1-932e85e2b3bd tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f269e146c844480c822347c3a38d103b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2b17b61b73b4e6d81dd8ffe9cf311ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:39:15.741674 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-4ddf99ed-5f01-443a-96f1-932e85e2b3bd tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] 10.222.0.42 "GET /compute/v2.1/servers/3bdaf03c-d0a2-4d6c-b0f1-ec2d580e63ef" status: 200 len: 1522 microversion: 2.1 time: 0.173267 Jun 06 10:39:15.748379 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 77/146] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:39:15 2022] GET /compute/v2.1/servers/3bdaf03c-d0a2-4d6c-b0f1-ec2d580e63ef => generated 1522 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:39:16.758651 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-2daf7add-92fa-483b-923b-8c3f56ad6bf1 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:39:16.759261 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-2daf7add-92fa-483b-923b-8c3f56ad6bf1 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] [instance: 3bdaf03c-d0a2-4d6c-b0f1-ec2d580e63ef] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:39:16.765579 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-2daf7add-92fa-483b-923b-8c3f56ad6bf1 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:39:16.766021 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-2daf7add-92fa-483b-923b-8c3f56ad6bf1 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:39:16.766776 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-2daf7add-92fa-483b-923b-8c3f56ad6bf1 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:39:16.767203 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-2daf7add-92fa-483b-923b-8c3f56ad6bf1 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:39:16.894603 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-2daf7add-92fa-483b-923b-8c3f56ad6bf1 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f269e146c844480c822347c3a38d103b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2b17b61b73b4e6d81dd8ffe9cf311ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:39:16.902831 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-2daf7add-92fa-483b-923b-8c3f56ad6bf1 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] 10.222.0.42 "GET /compute/v2.1/servers/3bdaf03c-d0a2-4d6c-b0f1-ec2d580e63ef" status: 200 len: 1522 microversion: 2.1 time: 0.147501 Jun 06 10:39:16.903590 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 70/147] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:39:16 2022] GET /compute/v2.1/servers/3bdaf03c-d0a2-4d6c-b0f1-ec2d580e63ef => generated 1522 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:39:17.920813 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-467c0499-aef2-41be-bb72-8aac105fa0d1 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:39:17.921353 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-467c0499-aef2-41be-bb72-8aac105fa0d1 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] [instance: 3bdaf03c-d0a2-4d6c-b0f1-ec2d580e63ef] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:39:17.927315 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-467c0499-aef2-41be-bb72-8aac105fa0d1 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:39:17.927761 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-467c0499-aef2-41be-bb72-8aac105fa0d1 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:39:17.930191 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-467c0499-aef2-41be-bb72-8aac105fa0d1 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:39:17.930191 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-467c0499-aef2-41be-bb72-8aac105fa0d1 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:39:18.073866 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-467c0499-aef2-41be-bb72-8aac105fa0d1 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f269e146c844480c822347c3a38d103b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2b17b61b73b4e6d81dd8ffe9cf311ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:39:18.081303 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-467c0499-aef2-41be-bb72-8aac105fa0d1 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] 10.222.0.42 "GET /compute/v2.1/servers/3bdaf03c-d0a2-4d6c-b0f1-ec2d580e63ef" status: 200 len: 1522 microversion: 2.1 time: 0.165972 Jun 06 10:39:18.082038 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 78/148] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:39:17 2022] GET /compute/v2.1/servers/3bdaf03c-d0a2-4d6c-b0f1-ec2d580e63ef => generated 1522 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:39:18.341364 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-da77b528-ffd5-4ce3-9b71-8273b4c996c6 tempest-VolumesTestJSON-584207457 tempest-VolumesTestJSON-584207457-project] Calling method '.version_select at 0x7f8fd831fee0>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:39:18.391845 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-da77b528-ffd5-4ce3-9b71-8273b4c996c6 tempest-VolumesTestJSON-584207457 tempest-VolumesTestJSON-584207457-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/63b2ef65-8e22-49ae-bfa6-c9f89cc2d243" status: 200 len: 350 microversion: 2.1 time: 0.055310 Jun 06 10:39:18.392733 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 71/149] 10.222.0.42 () {58 vars in 1244 bytes} [Mon Jun 6 10:39:18 2022] GET /compute/v2.1/os-volumes/63b2ef65-8e22-49ae-bfa6-c9f89cc2d243 => generated 350 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 10:39:19.052801 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-5241055f-d3e6-4e4f-8b56-18ed500f5adf tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1581747886", "imageRef": "6eea2d98-354d-4083-b74c-abcbb97f9e1a", "flavorRef": "452", "networks": [{"uuid": "ddf7599b-79d9-4e2b-be8b-aaed763d0ad2"}]}} {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 10:39:19.099634 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-8bb1891d-2ea5-43a9-8c24-bdd0e2230caa tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:39:19.100700 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-8bb1891d-2ea5-43a9-8c24-bdd0e2230caa tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] [instance: 3bdaf03c-d0a2-4d6c-b0f1-ec2d580e63ef] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:39:19.109382 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-8bb1891d-2ea5-43a9-8c24-bdd0e2230caa tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:39:19.110031 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-8bb1891d-2ea5-43a9-8c24-bdd0e2230caa tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:39:19.110822 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-8bb1891d-2ea5-43a9-8c24-bdd0e2230caa tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:39:19.111443 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-8bb1891d-2ea5-43a9-8c24-bdd0e2230caa tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:39:19.112262 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.network.neutron [None req-5241055f-d3e6-4e4f-8b56-18ed500f5adf tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] validate_networks() for [('ddf7599b-79d9-4e2b-be8b-aaed763d0ad2', None, None, None, None, None)] {{(pid=129349) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 06 10:39:19.328698 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-8bb1891d-2ea5-43a9-8c24-bdd0e2230caa tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f269e146c844480c822347c3a38d103b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2b17b61b73b4e6d81dd8ffe9cf311ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:39:19.328698 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG dbcounter [-] [129350] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 10:39:19.338832 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-8bb1891d-2ea5-43a9-8c24-bdd0e2230caa tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] 10.222.0.42 "GET /compute/v2.1/servers/3bdaf03c-d0a2-4d6c-b0f1-ec2d580e63ef" status: 200 len: 1522 microversion: 2.1 time: 0.244243 Jun 06 10:39:19.339722 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 72/150] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:39:19 2022] GET /compute/v2.1/servers/3bdaf03c-d0a2-4d6c-b0f1-ec2d580e63ef => generated 1522 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:39:19.540728 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.virt.hardware [None req-5241055f-d3e6-4e4f-8b56-18ed500f5adf tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] Flavor limits 0:0:0 {{(pid=129349) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 06 10:39:19.541173 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.virt.hardware [None req-5241055f-d3e6-4e4f-8b56-18ed500f5adf tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] Image limits 0:0:0 {{(pid=129349) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 06 10:39:19.541645 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.virt.hardware [None req-5241055f-d3e6-4e4f-8b56-18ed500f5adf tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] Flavor pref 0:0:0 {{(pid=129349) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 06 10:39:19.542080 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.virt.hardware [None req-5241055f-d3e6-4e4f-8b56-18ed500f5adf tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] Image pref 0:0:0 {{(pid=129349) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 06 10:39:19.542495 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.virt.hardware [None req-5241055f-d3e6-4e4f-8b56-18ed500f5adf tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129349) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 06 10:39:19.552861 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-5241055f-d3e6-4e4f-8b56-18ed500f5adf tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:39:19.553320 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-5241055f-d3e6-4e4f-8b56-18ed500f5adf tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:39:19.554086 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-5241055f-d3e6-4e4f-8b56-18ed500f5adf tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:39:19.554517 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-5241055f-d3e6-4e4f-8b56-18ed500f5adf tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:39:19.572227 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.quota [None req-5241055f-d3e6-4e4f-8b56-18ed500f5adf tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] Getting quotas for project b3b18ee23fb548709fc513c7e1cfe623. Resources: {'ram', 'cores', 'instances'} {{(pid=129349) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 06 10:39:19.576581 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.quota [None req-5241055f-d3e6-4e4f-8b56-18ed500f5adf tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] Getting quotas for user 446b13b4661542c097afafb32443dae4 and project b3b18ee23fb548709fc513c7e1cfe623. Resources: {'ram', 'cores', 'instances'} {{(pid=129349) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 06 10:39:19.588427 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-5241055f-d3e6-4e4f-8b56-18ed500f5adf tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] Going to run 1 instances... {{(pid=129349) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 06 10:39:19.591092 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-5241055f-d3e6-4e4f-8b56-18ed500f5adf tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] [instance: 732ab305-73a0-4a03-b0b7-d8f587f1654b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6eea2d98-354d-4083-b74c-abcbb97f9e1a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129349) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 06 10:39:19.635104 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-5241055f-d3e6-4e4f-8b56-18ed500f5adf tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.586282 Jun 06 10:39:19.635914 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 79/151] 10.222.0.42 () {60 vars in 1146 bytes} [Mon Jun 6 10:39:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 588 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 06 10:39:19.645903 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-de9f895a-afc7-4b7b-9d8b-519400cf1333 tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:39:19.646534 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-de9f895a-afc7-4b7b-9d8b-519400cf1333 tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] [instance: 732ab305-73a0-4a03-b0b7-d8f587f1654b] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:39:19.708420 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-de9f895a-afc7-4b7b-9d8b-519400cf1333 tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '446b13b4661542c097afafb32443dae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3b18ee23fb548709fc513c7e1cfe623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:39:19.716477 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-de9f895a-afc7-4b7b-9d8b-519400cf1333 tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] 10.222.0.42 "GET /compute/v2.1/servers/732ab305-73a0-4a03-b0b7-d8f587f1654b" status: 200 len: 1214 microversion: 2.1 time: 0.074632 Jun 06 10:39:19.717514 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 73/152] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:39:19 2022] GET /compute/v2.1/servers/732ab305-73a0-4a03-b0b7-d8f587f1654b => generated 1214 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:39:19.759760 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-2b052c19-ed81-45de-8bd5-5eb0ab76ee2b tempest-VolumesTestJSON-584207457 tempest-VolumesTestJSON-584207457-project] Calling method '.version_select at 0x7f8fd8448f70>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:39:19.816479 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-2b052c19-ed81-45de-8bd5-5eb0ab76ee2b tempest-VolumesTestJSON-584207457 tempest-VolumesTestJSON-584207457-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/84158f4a-fb7c-4632-a26a-e00860c9acc5" status: 200 len: 351 microversion: 2.1 time: 0.060477 Jun 06 10:39:19.823573 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 80/153] 10.222.0.42 () {58 vars in 1244 bytes} [Mon Jun 6 10:39:19 2022] GET /compute/v2.1/os-volumes/84158f4a-fb7c-4632-a26a-e00860c9acc5 => generated 351 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 10:39:20.358720 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-3fdacff6-8589-467d-9c84-7106d4dd974b tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:39:20.359243 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-3fdacff6-8589-467d-9c84-7106d4dd974b tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] [instance: 3bdaf03c-d0a2-4d6c-b0f1-ec2d580e63ef] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:39:20.365274 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-3fdacff6-8589-467d-9c84-7106d4dd974b tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:39:20.365716 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-3fdacff6-8589-467d-9c84-7106d4dd974b tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:39:20.366466 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-3fdacff6-8589-467d-9c84-7106d4dd974b tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:39:20.366890 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-3fdacff6-8589-467d-9c84-7106d4dd974b tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:39:20.496006 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-3fdacff6-8589-467d-9c84-7106d4dd974b tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f269e146c844480c822347c3a38d103b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2b17b61b73b4e6d81dd8ffe9cf311ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:39:20.503350 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-3fdacff6-8589-467d-9c84-7106d4dd974b tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] 10.222.0.42 "GET /compute/v2.1/servers/3bdaf03c-d0a2-4d6c-b0f1-ec2d580e63ef" status: 200 len: 1522 microversion: 2.1 time: 0.148867 Jun 06 10:39:20.503922 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 74/154] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:39:20 2022] GET /compute/v2.1/servers/3bdaf03c-d0a2-4d6c-b0f1-ec2d580e63ef => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:39:20.733168 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-b8670b76-20c4-40a4-8354-893ddbb36d96 tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:39:20.733776 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-b8670b76-20c4-40a4-8354-893ddbb36d96 tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] [instance: 732ab305-73a0-4a03-b0b7-d8f587f1654b] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:39:20.740531 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-b8670b76-20c4-40a4-8354-893ddbb36d96 tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:39:20.740974 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-b8670b76-20c4-40a4-8354-893ddbb36d96 tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:39:20.741732 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-b8670b76-20c4-40a4-8354-893ddbb36d96 tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:39:20.742162 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-b8670b76-20c4-40a4-8354-893ddbb36d96 tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:39:20.801806 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-b8670b76-20c4-40a4-8354-893ddbb36d96 tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '446b13b4661542c097afafb32443dae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3b18ee23fb548709fc513c7e1cfe623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:39:20.809628 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-b8670b76-20c4-40a4-8354-893ddbb36d96 tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] 10.222.0.42 "GET /compute/v2.1/servers/732ab305-73a0-4a03-b0b7-d8f587f1654b" status: 200 len: 1218 microversion: 2.1 time: 0.080844 Jun 06 10:39:20.810184 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 81/155] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:39:20 2022] GET /compute/v2.1/servers/732ab305-73a0-4a03-b0b7-d8f587f1654b => generated 1218 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:39:21.521024 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-f55c24f8-0ff4-4b38-94c1-b8d28dbd34a1 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:39:21.521640 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-f55c24f8-0ff4-4b38-94c1-b8d28dbd34a1 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] [instance: 3bdaf03c-d0a2-4d6c-b0f1-ec2d580e63ef] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:39:21.528422 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-f55c24f8-0ff4-4b38-94c1-b8d28dbd34a1 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:39:21.528861 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-f55c24f8-0ff4-4b38-94c1-b8d28dbd34a1 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:39:21.529612 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-f55c24f8-0ff4-4b38-94c1-b8d28dbd34a1 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:39:21.530038 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-f55c24f8-0ff4-4b38-94c1-b8d28dbd34a1 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:39:21.657968 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-f55c24f8-0ff4-4b38-94c1-b8d28dbd34a1 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f269e146c844480c822347c3a38d103b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2b17b61b73b4e6d81dd8ffe9cf311ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:39:21.665557 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-f55c24f8-0ff4-4b38-94c1-b8d28dbd34a1 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] 10.222.0.42 "GET /compute/v2.1/servers/3bdaf03c-d0a2-4d6c-b0f1-ec2d580e63ef" status: 200 len: 1522 microversion: 2.1 time: 0.148627 Jun 06 10:39:21.666128 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 75/156] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:39:21 2022] GET /compute/v2.1/servers/3bdaf03c-d0a2-4d6c-b0f1-ec2d580e63ef => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:39:21.826762 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-4b499e49-7ad0-4c77-ae3b-f021798ebbb1 tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:39:21.827370 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-4b499e49-7ad0-4c77-ae3b-f021798ebbb1 tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] [instance: 732ab305-73a0-4a03-b0b7-d8f587f1654b] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:39:21.833819 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-4b499e49-7ad0-4c77-ae3b-f021798ebbb1 tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:39:21.834261 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-4b499e49-7ad0-4c77-ae3b-f021798ebbb1 tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:39:21.835019 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-4b499e49-7ad0-4c77-ae3b-f021798ebbb1 tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:39:21.835446 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-4b499e49-7ad0-4c77-ae3b-f021798ebbb1 tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:39:21.853773 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG dbcounter [-] [129349] Writing DB stats nova_cell1:SELECT=100 {{(pid=129349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 10:39:21.895943 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-4b499e49-7ad0-4c77-ae3b-f021798ebbb1 tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '446b13b4661542c097afafb32443dae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3b18ee23fb548709fc513c7e1cfe623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:39:21.903888 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-4b499e49-7ad0-4c77-ae3b-f021798ebbb1 tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] 10.222.0.42 "GET /compute/v2.1/servers/732ab305-73a0-4a03-b0b7-d8f587f1654b" status: 200 len: 1218 microversion: 2.1 time: 0.081496 Jun 06 10:39:21.904444 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 82/157] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:39:21 2022] GET /compute/v2.1/servers/732ab305-73a0-4a03-b0b7-d8f587f1654b => generated 1218 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:39:22.682370 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-2a719cc1-aaa2-40e2-a705-c86e815206e2 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:39:22.682901 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-2a719cc1-aaa2-40e2-a705-c86e815206e2 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] [instance: 3bdaf03c-d0a2-4d6c-b0f1-ec2d580e63ef] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:39:22.690171 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-2a719cc1-aaa2-40e2-a705-c86e815206e2 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:39:22.690610 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-2a719cc1-aaa2-40e2-a705-c86e815206e2 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:39:22.691359 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-2a719cc1-aaa2-40e2-a705-c86e815206e2 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:39:22.691805 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-2a719cc1-aaa2-40e2-a705-c86e815206e2 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:39:22.823665 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-2a719cc1-aaa2-40e2-a705-c86e815206e2 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f269e146c844480c822347c3a38d103b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2b17b61b73b4e6d81dd8ffe9cf311ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:39:22.832117 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-2a719cc1-aaa2-40e2-a705-c86e815206e2 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] 10.222.0.42 "GET /compute/v2.1/servers/3bdaf03c-d0a2-4d6c-b0f1-ec2d580e63ef" status: 200 len: 1522 microversion: 2.1 time: 0.153578 Jun 06 10:39:22.832678 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 76/158] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:39:22 2022] GET /compute/v2.1/servers/3bdaf03c-d0a2-4d6c-b0f1-ec2d580e63ef => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:39:22.920520 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-4529d455-cc55-484f-8430-b33cb08a45cc tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:39:22.921125 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-4529d455-cc55-484f-8430-b33cb08a45cc tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] [instance: 732ab305-73a0-4a03-b0b7-d8f587f1654b] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:39:22.927516 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-4529d455-cc55-484f-8430-b33cb08a45cc tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:39:22.928012 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-4529d455-cc55-484f-8430-b33cb08a45cc tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:39:22.928765 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-4529d455-cc55-484f-8430-b33cb08a45cc tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:39:22.929190 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-4529d455-cc55-484f-8430-b33cb08a45cc tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:39:22.992336 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-4529d455-cc55-484f-8430-b33cb08a45cc tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '446b13b4661542c097afafb32443dae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3b18ee23fb548709fc513c7e1cfe623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:39:23.000414 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-4529d455-cc55-484f-8430-b33cb08a45cc tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] 10.222.0.42 "GET /compute/v2.1/servers/732ab305-73a0-4a03-b0b7-d8f587f1654b" status: 200 len: 1266 microversion: 2.1 time: 0.083806 Jun 06 10:39:23.000968 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 83/159] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:39:22 2022] GET /compute/v2.1/servers/732ab305-73a0-4a03-b0b7-d8f587f1654b => generated 1266 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:39:23.849132 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-85195bc2-e31b-480d-a7ff-dca50e7fcbbe tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:39:23.850302 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-85195bc2-e31b-480d-a7ff-dca50e7fcbbe tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] [instance: 3bdaf03c-d0a2-4d6c-b0f1-ec2d580e63ef] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:39:23.857517 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-85195bc2-e31b-480d-a7ff-dca50e7fcbbe tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:39:23.857965 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-85195bc2-e31b-480d-a7ff-dca50e7fcbbe tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:39:23.858728 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-85195bc2-e31b-480d-a7ff-dca50e7fcbbe tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:39:23.859152 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-85195bc2-e31b-480d-a7ff-dca50e7fcbbe tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:39:24.018155 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-72c19780-6964-4c2a-ba2b-12f5cfba4d30 tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:39:24.018807 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-72c19780-6964-4c2a-ba2b-12f5cfba4d30 tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] [instance: 732ab305-73a0-4a03-b0b7-d8f587f1654b] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:39:24.030990 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-72c19780-6964-4c2a-ba2b-12f5cfba4d30 tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:39:24.031436 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-72c19780-6964-4c2a-ba2b-12f5cfba4d30 tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:39:24.032400 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-72c19780-6964-4c2a-ba2b-12f5cfba4d30 tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:39:24.033659 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-72c19780-6964-4c2a-ba2b-12f5cfba4d30 tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:39:24.075504 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-85195bc2-e31b-480d-a7ff-dca50e7fcbbe tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f269e146c844480c822347c3a38d103b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2b17b61b73b4e6d81dd8ffe9cf311ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:39:24.093393 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-85195bc2-e31b-480d-a7ff-dca50e7fcbbe tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] 10.222.0.42 "GET /compute/v2.1/servers/3bdaf03c-d0a2-4d6c-b0f1-ec2d580e63ef" status: 200 len: 1522 microversion: 2.1 time: 0.247386 Jun 06 10:39:24.095202 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 77/160] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:39:23 2022] GET /compute/v2.1/servers/3bdaf03c-d0a2-4d6c-b0f1-ec2d580e63ef => generated 1522 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:39:24.135431 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-72c19780-6964-4c2a-ba2b-12f5cfba4d30 tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '446b13b4661542c097afafb32443dae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3b18ee23fb548709fc513c7e1cfe623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:39:24.144562 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-72c19780-6964-4c2a-ba2b-12f5cfba4d30 tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] 10.222.0.42 "GET /compute/v2.1/servers/732ab305-73a0-4a03-b0b7-d8f587f1654b" status: 200 len: 1272 microversion: 2.1 time: 0.130283 Jun 06 10:39:24.145391 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 84/161] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:39:24 2022] GET /compute/v2.1/servers/732ab305-73a0-4a03-b0b7-d8f587f1654b => generated 1272 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 10:39:24.338378 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-4005b6b5-6812-4ab3-b4b2-af09ada477a8 tempest-VolumesTestJSON-584207457 tempest-VolumesTestJSON-584207457-project] Calling method '.version_select at 0x7f8fd84fc430>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:39:24.418008 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-4005b6b5-6812-4ab3-b4b2-af09ada477a8 tempest-VolumesTestJSON-584207457 tempest-VolumesTestJSON-584207457-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/9d6260c1-6e6f-4f8f-8159-83c22f60937b" status: 200 len: 350 microversion: 2.1 time: 0.083596 Jun 06 10:39:24.418842 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 78/162] 10.222.0.42 () {58 vars in 1244 bytes} [Mon Jun 6 10:39:24 2022] GET /compute/v2.1/os-volumes/9d6260c1-6e6f-4f8f-8159-83c22f60937b => generated 350 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 10:39:24.430284 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-97ae8217-0c36-422d-a436-cbc0c8ca727f tempest-VolumesTestJSON-584207457 tempest-VolumesTestJSON-584207457-project] Calling method '.version_select at 0x7f8fd8356a60>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:39:24.532816 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-97ae8217-0c36-422d-a436-cbc0c8ca727f tempest-VolumesTestJSON-584207457 tempest-VolumesTestJSON-584207457-project] 10.222.0.42 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.106493 Jun 06 10:39:24.533371 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 85/163] 10.222.0.42 () {58 vars in 1133 bytes} [Mon Jun 6 10:39:24 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:39:24.545696 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-1609e0cd-de82-4769-adae-266eeac66e2e tempest-VolumesTestJSON-584207457 tempest-VolumesTestJSON-584207457-project] Calling method '.version_select at 0x7f8fd83240d0>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:39:24.627837 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-1609e0cd-de82-4769-adae-266eeac66e2e tempest-VolumesTestJSON-584207457 tempest-VolumesTestJSON-584207457-project] 10.222.0.42 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.086091 Jun 06 10:39:24.628570 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 79/164] 10.222.0.42 () {58 vars in 1148 bytes} [Mon Jun 6 10:39:24 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 10:39:24.640981 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-38f00950-fd6f-42a0-8416-81143c25194c tempest-VolumesTestJSON-584207457 tempest-VolumesTestJSON-584207457-project] Calling method '.version_select at 0x7f8fd832b160>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:39:24.726659 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-38f00950-fd6f-42a0-8416-81143c25194c tempest-VolumesTestJSON-584207457 tempest-VolumesTestJSON-584207457-project] 10.222.0.42 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.090202 Jun 06 10:39:24.727425 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 86/165] 10.222.0.42 () {58 vars in 1133 bytes} [Mon Jun 6 10:39:24 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:39:24.739450 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-e5233001-0952-45c3-9117-4367b196e7a2 tempest-VolumesTestJSON-584207457 tempest-VolumesTestJSON-584207457-project] Calling method '.version_select at 0x7f8fd82c45e0>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:39:24.825330 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-e5233001-0952-45c3-9117-4367b196e7a2 tempest-VolumesTestJSON-584207457 tempest-VolumesTestJSON-584207457-project] 10.222.0.42 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.089596 Jun 06 10:39:24.825892 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 80/166] 10.222.0.42 () {58 vars in 1166 bytes} [Mon Jun 6 10:39:24 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 10:39:24.838538 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-2bcb7784-2da3-4254-9ece-802520b990ed tempest-VolumesTestJSON-584207457 tempest-VolumesTestJSON-584207457-project] Calling method '.version_select at 0x7f8fd832bdc0>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:39:24.925124 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-2bcb7784-2da3-4254-9ece-802520b990ed tempest-VolumesTestJSON-584207457 tempest-VolumesTestJSON-584207457-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.090577 Jun 06 10:39:24.925726 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 87/167] 10.222.0.42 () {58 vars in 1169 bytes} [Mon Jun 6 10:39:24 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 10:39:24.938707 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-590d15f0-0e85-4b26-b0c2-0ddae087f9ba tempest-VolumesTestJSON-584207457 tempest-VolumesTestJSON-584207457-project] Calling method '.version_select at 0x7f8fd84fc430>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:39:25.028221 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-590d15f0-0e85-4b26-b0c2-0ddae087f9ba tempest-VolumesTestJSON-584207457 tempest-VolumesTestJSON-584207457-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.093478 Jun 06 10:39:25.028847 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 81/168] 10.222.0.42 () {58 vars in 1154 bytes} [Mon Jun 6 10:39:24 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:39:25.041163 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-5e2a5c8a-2b49-49a8-9dc5-d51295ea930f tempest-VolumesTestJSON-584207457 tempest-VolumesTestJSON-584207457-project] Calling method '.version_select at 0x7f8fd832b5e0>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:39:25.111431 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-7a8f8dac-dad9-47a2-9ab1-62c4c111e06b tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:39:25.112126 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-7a8f8dac-dad9-47a2-9ab1-62c4c111e06b tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] [instance: 3bdaf03c-d0a2-4d6c-b0f1-ec2d580e63ef] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:39:25.120206 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-7a8f8dac-dad9-47a2-9ab1-62c4c111e06b tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:39:25.121254 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-7a8f8dac-dad9-47a2-9ab1-62c4c111e06b tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:39:25.122153 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-7a8f8dac-dad9-47a2-9ab1-62c4c111e06b tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:39:25.122748 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-7a8f8dac-dad9-47a2-9ab1-62c4c111e06b tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:39:25.127867 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-5e2a5c8a-2b49-49a8-9dc5-d51295ea930f tempest-VolumesTestJSON-584207457 tempest-VolumesTestJSON-584207457-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.091443 Jun 06 10:39:25.128429 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 88/169] 10.222.0.42 () {58 vars in 1187 bytes} [Mon Jun 6 10:39:25 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 10:39:25.140671 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-3cca8892-4f1c-483a-ba76-663d72dbbc1b tempest-VolumesTestJSON-584207457 tempest-VolumesTestJSON-584207457-project] Calling method '.version_select at 0x7f8fd8448af0>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:39:25.255438 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-3cca8892-4f1c-483a-ba76-663d72dbbc1b tempest-VolumesTestJSON-584207457 tempest-VolumesTestJSON-584207457-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.119213 Jun 06 10:39:25.259611 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 89/170] 10.222.0.42 () {58 vars in 1154 bytes} [Mon Jun 6 10:39:25 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:39:25.281215 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-646d72fd-0590-432c-b0d7-0bb1690b6e91 tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:39:25.287295 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-646d72fd-0590-432c-b0d7-0bb1690b6e91 tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] [instance: 732ab305-73a0-4a03-b0b7-d8f587f1654b] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:39:25.311307 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-646d72fd-0590-432c-b0d7-0bb1690b6e91 tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:39:25.312285 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-646d72fd-0590-432c-b0d7-0bb1690b6e91 tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:39:25.314130 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-646d72fd-0590-432c-b0d7-0bb1690b6e91 tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:39:25.315979 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-646d72fd-0590-432c-b0d7-0bb1690b6e91 tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:39:25.417035 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-7a8f8dac-dad9-47a2-9ab1-62c4c111e06b tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f269e146c844480c822347c3a38d103b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2b17b61b73b4e6d81dd8ffe9cf311ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:39:25.432068 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-7a8f8dac-dad9-47a2-9ab1-62c4c111e06b tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] 10.222.0.42 "GET /compute/v2.1/servers/3bdaf03c-d0a2-4d6c-b0f1-ec2d580e63ef" status: 200 len: 1522 microversion: 2.1 time: 0.324748 Jun 06 10:39:25.433107 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 82/171] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:39:25 2022] GET /compute/v2.1/servers/3bdaf03c-d0a2-4d6c-b0f1-ec2d580e63ef => generated 1522 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:39:25.797272 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [req-d17a4482-7fcc-4562-91d3-d47e2594e6ef req-c46b7bd8-e1e2-46d6-88ff-2f038231de91 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "732ab305-73a0-4a03-b0b7-d8f587f1654b", "tag": "6defd997-423f-4a99-b1dd-b66c7aa6d4dd"}]} {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 10:39:25.806273 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [req-d17a4482-7fcc-4562-91d3-d47e2594e6ef req-c46b7bd8-e1e2-46d6-88ff-2f038231de91 service nova] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:39:25.806717 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [req-d17a4482-7fcc-4562-91d3-d47e2594e6ef req-c46b7bd8-e1e2-46d6-88ff-2f038231de91 service nova] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:39:25.820714 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.compute.server_external_events [req-d17a4482-7fcc-4562-91d3-d47e2594e6ef req-c46b7bd8-e1e2-46d6-88ff-2f038231de91 service nova] Creating event network-changed:6defd997-423f-4a99-b1dd-b66c7aa6d4dd for instance 732ab305-73a0-4a03-b0b7-d8f587f1654b on hv-cinder-84482 Jun 06 10:39:25.823357 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-646d72fd-0590-432c-b0d7-0bb1690b6e91 tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '446b13b4661542c097afafb32443dae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3b18ee23fb548709fc513c7e1cfe623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:39:25.827301 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [req-d17a4482-7fcc-4562-91d3-d47e2594e6ef req-c46b7bd8-e1e2-46d6-88ff-2f038231de91 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033552 Jun 06 10:39:25.828995 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 83/172] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Jun 6 10:39:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 10:39:25.837720 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-646d72fd-0590-432c-b0d7-0bb1690b6e91 tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] 10.222.0.42 "GET /compute/v2.1/servers/732ab305-73a0-4a03-b0b7-d8f587f1654b" status: 200 len: 1314 microversion: 2.1 time: 0.576871 Jun 06 10:39:25.856388 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 90/173] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:39:25 2022] GET /compute/v2.1/servers/732ab305-73a0-4a03-b0b7-d8f587f1654b => generated 1314 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:39:26.459711 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-aa91e9e2-b227-47ea-860a-377c735d171d tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:39:26.460451 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-aa91e9e2-b227-47ea-860a-377c735d171d tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] [instance: 3bdaf03c-d0a2-4d6c-b0f1-ec2d580e63ef] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:39:26.468494 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-aa91e9e2-b227-47ea-860a-377c735d171d tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:39:26.468943 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-aa91e9e2-b227-47ea-860a-377c735d171d tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:39:26.470318 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-aa91e9e2-b227-47ea-860a-377c735d171d tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:39:26.470764 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-aa91e9e2-b227-47ea-860a-377c735d171d tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:39:26.635412 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-aa91e9e2-b227-47ea-860a-377c735d171d tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f269e146c844480c822347c3a38d103b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2b17b61b73b4e6d81dd8ffe9cf311ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:39:26.672435 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-aa91e9e2-b227-47ea-860a-377c735d171d tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] 10.222.0.42 "GET /compute/v2.1/servers/3bdaf03c-d0a2-4d6c-b0f1-ec2d580e63ef" status: 200 len: 1502 microversion: 2.1 time: 0.211990 Jun 06 10:39:26.672435 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 84/174] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:39:26 2022] GET /compute/v2.1/servers/3bdaf03c-d0a2-4d6c-b0f1-ec2d580e63ef => generated 1502 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:39:26.688473 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-19eaa8c8-0494-4c28-9c4e-8003620e9d7b tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:39:26.689095 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-19eaa8c8-0494-4c28-9c4e-8003620e9d7b tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] [instance: 6345448b-01b7-4429-bb10-fc5ae449ef71] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:39:26.700063 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-19eaa8c8-0494-4c28-9c4e-8003620e9d7b tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:39:26.700799 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-19eaa8c8-0494-4c28-9c4e-8003620e9d7b tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:39:26.701756 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-19eaa8c8-0494-4c28-9c4e-8003620e9d7b tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:39:26.702155 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-19eaa8c8-0494-4c28-9c4e-8003620e9d7b tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:39:26.845830 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-19eaa8c8-0494-4c28-9c4e-8003620e9d7b tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f269e146c844480c822347c3a38d103b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2b17b61b73b4e6d81dd8ffe9cf311ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:39:26.853890 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-19eaa8c8-0494-4c28-9c4e-8003620e9d7b tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] 10.222.0.42 "GET /compute/v2.1/servers/6345448b-01b7-4429-bb10-fc5ae449ef71" status: 200 len: 1516 microversion: 2.1 time: 0.171204 Jun 06 10:39:26.854448 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 91/175] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:39:26 2022] GET /compute/v2.1/servers/6345448b-01b7-4429-bb10-fc5ae449ef71 => generated 1516 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:39:26.855526 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-f06369b2-a0ce-4967-839f-5559eea9587a tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:39:26.856604 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-f06369b2-a0ce-4967-839f-5559eea9587a tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] [instance: 732ab305-73a0-4a03-b0b7-d8f587f1654b] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:39:26.862659 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-f06369b2-a0ce-4967-839f-5559eea9587a tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:39:26.863097 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-f06369b2-a0ce-4967-839f-5559eea9587a tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:39:26.863891 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-f06369b2-a0ce-4967-839f-5559eea9587a tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:39:26.864354 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-f06369b2-a0ce-4967-839f-5559eea9587a tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:39:27.029527 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-f06369b2-a0ce-4967-839f-5559eea9587a tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '446b13b4661542c097afafb32443dae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3b18ee23fb548709fc513c7e1cfe623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:39:27.041195 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-f06369b2-a0ce-4967-839f-5559eea9587a tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] 10.222.0.42 "GET /compute/v2.1/servers/732ab305-73a0-4a03-b0b7-d8f587f1654b" status: 200 len: 1314 microversion: 2.1 time: 0.190112 Jun 06 10:39:27.053813 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 85/176] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:39:26 2022] GET /compute/v2.1/servers/732ab305-73a0-4a03-b0b7-d8f587f1654b => generated 1314 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:39:28.062093 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-63cc220b-7324-48c3-bab3-11bf8dd3834e tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:39:28.062707 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-63cc220b-7324-48c3-bab3-11bf8dd3834e tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] [instance: 732ab305-73a0-4a03-b0b7-d8f587f1654b] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:39:28.068905 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-63cc220b-7324-48c3-bab3-11bf8dd3834e tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:39:28.069354 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-63cc220b-7324-48c3-bab3-11bf8dd3834e tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:39:28.070119 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-63cc220b-7324-48c3-bab3-11bf8dd3834e tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:39:28.070548 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-63cc220b-7324-48c3-bab3-11bf8dd3834e tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:39:28.203368 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-63cc220b-7324-48c3-bab3-11bf8dd3834e tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '446b13b4661542c097afafb32443dae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3b18ee23fb548709fc513c7e1cfe623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:39:28.210756 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-63cc220b-7324-48c3-bab3-11bf8dd3834e tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] 10.222.0.42 "GET /compute/v2.1/servers/732ab305-73a0-4a03-b0b7-d8f587f1654b" status: 200 len: 1314 microversion: 2.1 time: 0.152740 Jun 06 10:39:28.211317 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 92/177] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:39:28 2022] GET /compute/v2.1/servers/732ab305-73a0-4a03-b0b7-d8f587f1654b => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:39:28.308793 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-61ef381f-e9a2-49a8-ae25-13fe07785877 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 10:39:28.309789 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-61ef381f-e9a2-49a8-ae25-13fe07785877 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] [instance: 6345448b-01b7-4429-bb10-fc5ae449ef71] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:39:28.315744 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-61ef381f-e9a2-49a8-ae25-13fe07785877 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:39:28.316228 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-61ef381f-e9a2-49a8-ae25-13fe07785877 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:39:28.316983 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-61ef381f-e9a2-49a8-ae25-13fe07785877 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:39:28.317414 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-61ef381f-e9a2-49a8-ae25-13fe07785877 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:39:28.339806 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.objects.instance [None req-61ef381f-e9a2-49a8-ae25-13fe07785877 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lazy-loading 'flavor' on Instance uuid 6345448b-01b7-4429-bb10-fc5ae449ef71 {{(pid=129350) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 06 10:39:28.412607 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-61ef381f-e9a2-49a8-ae25-13fe07785877 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] 10.222.0.42 "POST /compute/v2.1/servers/6345448b-01b7-4429-bb10-fc5ae449ef71/action" status: 200 len: 32 microversion: 2.1 time: 0.107793 Jun 06 10:39:28.413234 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 86/178] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Jun 6 10:39:28 2022] POST /compute/v2.1/servers/6345448b-01b7-4429-bb10-fc5ae449ef71/action => generated 32 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 06 10:39:28.422945 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-870f5767-7715-41d1-8028-dac2be17e44a tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:39:28.423584 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-870f5767-7715-41d1-8028-dac2be17e44a tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] [instance: 6345448b-01b7-4429-bb10-fc5ae449ef71] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:39:28.429514 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-870f5767-7715-41d1-8028-dac2be17e44a tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:39:28.429960 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-870f5767-7715-41d1-8028-dac2be17e44a tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:39:28.430719 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-870f5767-7715-41d1-8028-dac2be17e44a tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:39:28.431150 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-870f5767-7715-41d1-8028-dac2be17e44a tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:39:28.560346 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-870f5767-7715-41d1-8028-dac2be17e44a tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f269e146c844480c822347c3a38d103b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2b17b61b73b4e6d81dd8ffe9cf311ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:39:28.567708 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-870f5767-7715-41d1-8028-dac2be17e44a tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] 10.222.0.42 "GET /compute/v2.1/servers/6345448b-01b7-4429-bb10-fc5ae449ef71" status: 200 len: 1522 microversion: 2.1 time: 0.148512 Jun 06 10:39:28.568289 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 93/179] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:39:28 2022] GET /compute/v2.1/servers/6345448b-01b7-4429-bb10-fc5ae449ef71 => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:39:29.229862 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-edb14d50-336a-4456-a9ad-02304d78218e tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:39:29.230658 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-edb14d50-336a-4456-a9ad-02304d78218e tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] [instance: 732ab305-73a0-4a03-b0b7-d8f587f1654b] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:39:29.238303 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-edb14d50-336a-4456-a9ad-02304d78218e tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:39:29.238827 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-edb14d50-336a-4456-a9ad-02304d78218e tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:39:29.239840 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-edb14d50-336a-4456-a9ad-02304d78218e tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:39:29.240347 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-edb14d50-336a-4456-a9ad-02304d78218e tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:39:29.378226 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-edb14d50-336a-4456-a9ad-02304d78218e tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '446b13b4661542c097afafb32443dae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3b18ee23fb548709fc513c7e1cfe623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:39:29.390745 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-edb14d50-336a-4456-a9ad-02304d78218e tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] 10.222.0.42 "GET /compute/v2.1/servers/732ab305-73a0-4a03-b0b7-d8f587f1654b" status: 200 len: 1314 microversion: 2.1 time: 0.166104 Jun 06 10:39:29.391398 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 87/180] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:39:29 2022] GET /compute/v2.1/servers/732ab305-73a0-4a03-b0b7-d8f587f1654b => generated 1314 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:39:29.585253 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-d7a85a2f-15f2-449c-9ca3-c97458ab7652 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:39:29.585870 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-d7a85a2f-15f2-449c-9ca3-c97458ab7652 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] [instance: 6345448b-01b7-4429-bb10-fc5ae449ef71] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:39:29.588209 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG dbcounter [-] [129349] Writing DB stats nova_cell0:SELECT=2 {{(pid=129349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 10:39:29.588864 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG dbcounter [-] [129349] Writing DB stats nova_cell0:SELECT=6 {{(pid=129349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 10:39:29.595155 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-d7a85a2f-15f2-449c-9ca3-c97458ab7652 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:39:29.595728 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-d7a85a2f-15f2-449c-9ca3-c97458ab7652 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:39:29.596536 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-d7a85a2f-15f2-449c-9ca3-c97458ab7652 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:39:29.596963 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-d7a85a2f-15f2-449c-9ca3-c97458ab7652 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:39:29.726684 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-d7a85a2f-15f2-449c-9ca3-c97458ab7652 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f269e146c844480c822347c3a38d103b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2b17b61b73b4e6d81dd8ffe9cf311ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:39:29.734177 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-d7a85a2f-15f2-449c-9ca3-c97458ab7652 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] 10.222.0.42 "GET /compute/v2.1/servers/6345448b-01b7-4429-bb10-fc5ae449ef71" status: 200 len: 1522 microversion: 2.1 time: 0.152687 Jun 06 10:39:29.734736 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 94/181] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:39:29 2022] GET /compute/v2.1/servers/6345448b-01b7-4429-bb10-fc5ae449ef71 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:39:30.408982 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-883ffc5f-eae0-41bc-94de-1e10d58aa7a3 tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:39:30.409589 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-883ffc5f-eae0-41bc-94de-1e10d58aa7a3 tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] [instance: 732ab305-73a0-4a03-b0b7-d8f587f1654b] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:39:30.411517 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG dbcounter [-] [129350] Writing DB stats nova_cell0:SELECT=2 {{(pid=129350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 10:39:30.416845 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-883ffc5f-eae0-41bc-94de-1e10d58aa7a3 tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:39:30.417973 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-883ffc5f-eae0-41bc-94de-1e10d58aa7a3 tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:39:30.418720 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-883ffc5f-eae0-41bc-94de-1e10d58aa7a3 tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:39:30.419143 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-883ffc5f-eae0-41bc-94de-1e10d58aa7a3 tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:39:30.578901 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-883ffc5f-eae0-41bc-94de-1e10d58aa7a3 tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '446b13b4661542c097afafb32443dae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3b18ee23fb548709fc513c7e1cfe623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:39:30.586704 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-883ffc5f-eae0-41bc-94de-1e10d58aa7a3 tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] 10.222.0.42 "GET /compute/v2.1/servers/732ab305-73a0-4a03-b0b7-d8f587f1654b" status: 200 len: 1314 microversion: 2.1 time: 0.181444 Jun 06 10:39:30.587166 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 88/182] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:39:30 2022] GET /compute/v2.1/servers/732ab305-73a0-4a03-b0b7-d8f587f1654b => generated 1314 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:39:30.750502 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-11122f67-2b6b-4119-951a-2745b6edb571 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:39:30.751117 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-11122f67-2b6b-4119-951a-2745b6edb571 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] [instance: 6345448b-01b7-4429-bb10-fc5ae449ef71] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:39:30.758281 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-11122f67-2b6b-4119-951a-2745b6edb571 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:39:30.758729 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-11122f67-2b6b-4119-951a-2745b6edb571 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:39:30.759495 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-11122f67-2b6b-4119-951a-2745b6edb571 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:39:30.759980 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-11122f67-2b6b-4119-951a-2745b6edb571 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:39:30.976023 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-11122f67-2b6b-4119-951a-2745b6edb571 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f269e146c844480c822347c3a38d103b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2b17b61b73b4e6d81dd8ffe9cf311ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:39:30.984457 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-11122f67-2b6b-4119-951a-2745b6edb571 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] 10.222.0.42 "GET /compute/v2.1/servers/6345448b-01b7-4429-bb10-fc5ae449ef71" status: 200 len: 1522 microversion: 2.1 time: 0.237776 Jun 06 10:39:30.985146 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 95/183] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:39:30 2022] GET /compute/v2.1/servers/6345448b-01b7-4429-bb10-fc5ae449ef71 => generated 1522 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:39:31.604345 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-1215b7c3-8a9c-48a1-bdaa-48801d477f08 tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:39:31.607255 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-1215b7c3-8a9c-48a1-bdaa-48801d477f08 tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] [instance: 732ab305-73a0-4a03-b0b7-d8f587f1654b] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:39:31.613297 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-1215b7c3-8a9c-48a1-bdaa-48801d477f08 tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:39:31.613728 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-1215b7c3-8a9c-48a1-bdaa-48801d477f08 tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:39:31.614478 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-1215b7c3-8a9c-48a1-bdaa-48801d477f08 tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:39:31.614909 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-1215b7c3-8a9c-48a1-bdaa-48801d477f08 tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:39:31.753979 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-1215b7c3-8a9c-48a1-bdaa-48801d477f08 tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '446b13b4661542c097afafb32443dae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3b18ee23fb548709fc513c7e1cfe623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:39:31.762083 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-1215b7c3-8a9c-48a1-bdaa-48801d477f08 tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] 10.222.0.42 "GET /compute/v2.1/servers/732ab305-73a0-4a03-b0b7-d8f587f1654b" status: 200 len: 1314 microversion: 2.1 time: 0.161434 Jun 06 10:39:31.762738 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 89/184] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:39:31 2022] GET /compute/v2.1/servers/732ab305-73a0-4a03-b0b7-d8f587f1654b => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:39:32.003766 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-b3aa8aec-f771-4f5d-ace0-dcdfc26403fe tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:39:32.005064 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-b3aa8aec-f771-4f5d-ace0-dcdfc26403fe tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] [instance: 6345448b-01b7-4429-bb10-fc5ae449ef71] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:39:32.013314 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-b3aa8aec-f771-4f5d-ace0-dcdfc26403fe tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:39:32.013977 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-b3aa8aec-f771-4f5d-ace0-dcdfc26403fe tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:39:32.014874 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-b3aa8aec-f771-4f5d-ace0-dcdfc26403fe tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:39:32.015583 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-b3aa8aec-f771-4f5d-ace0-dcdfc26403fe tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:39:32.154363 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-b3aa8aec-f771-4f5d-ace0-dcdfc26403fe tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f269e146c844480c822347c3a38d103b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2b17b61b73b4e6d81dd8ffe9cf311ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:39:32.161971 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-b3aa8aec-f771-4f5d-ace0-dcdfc26403fe tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] 10.222.0.42 "GET /compute/v2.1/servers/6345448b-01b7-4429-bb10-fc5ae449ef71" status: 200 len: 1522 microversion: 2.1 time: 0.163656 Jun 06 10:39:32.162537 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 96/185] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:39:31 2022] GET /compute/v2.1/servers/6345448b-01b7-4429-bb10-fc5ae449ef71 => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:39:32.778833 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-30bc2477-4efe-4114-8092-c3265037078d tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:39:32.779683 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-30bc2477-4efe-4114-8092-c3265037078d tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] [instance: 732ab305-73a0-4a03-b0b7-d8f587f1654b] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:39:32.785811 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-30bc2477-4efe-4114-8092-c3265037078d tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:39:32.786194 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-30bc2477-4efe-4114-8092-c3265037078d tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:39:32.786953 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-30bc2477-4efe-4114-8092-c3265037078d tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:39:32.787382 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-30bc2477-4efe-4114-8092-c3265037078d tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:39:32.970796 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-30bc2477-4efe-4114-8092-c3265037078d tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '446b13b4661542c097afafb32443dae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3b18ee23fb548709fc513c7e1cfe623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:39:32.978998 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-30bc2477-4efe-4114-8092-c3265037078d tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] 10.222.0.42 "GET /compute/v2.1/servers/732ab305-73a0-4a03-b0b7-d8f587f1654b" status: 200 len: 1314 microversion: 2.1 time: 0.203851 Jun 06 10:39:32.981124 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 90/186] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:39:32 2022] GET /compute/v2.1/servers/732ab305-73a0-4a03-b0b7-d8f587f1654b => generated 1314 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:39:33.179692 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-03c9e2b7-39d9-4874-8701-d12ac90cb497 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:39:33.180336 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-03c9e2b7-39d9-4874-8701-d12ac90cb497 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] [instance: 6345448b-01b7-4429-bb10-fc5ae449ef71] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:39:33.183192 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG dbcounter [-] [129349] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=3 {{(pid=129349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 10:39:33.188739 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-03c9e2b7-39d9-4874-8701-d12ac90cb497 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:39:33.189179 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-03c9e2b7-39d9-4874-8701-d12ac90cb497 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:39:33.189949 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-03c9e2b7-39d9-4874-8701-d12ac90cb497 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:39:33.190381 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-03c9e2b7-39d9-4874-8701-d12ac90cb497 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:39:33.332210 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-03c9e2b7-39d9-4874-8701-d12ac90cb497 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f269e146c844480c822347c3a38d103b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2b17b61b73b4e6d81dd8ffe9cf311ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:39:33.340607 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-03c9e2b7-39d9-4874-8701-d12ac90cb497 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] 10.222.0.42 "GET /compute/v2.1/servers/6345448b-01b7-4429-bb10-fc5ae449ef71" status: 200 len: 1522 microversion: 2.1 time: 0.164642 Jun 06 10:39:33.341316 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 97/187] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:39:33 2022] GET /compute/v2.1/servers/6345448b-01b7-4429-bb10-fc5ae449ef71 => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:39:33.996792 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-fa31f1d7-8b88-44e9-82a6-006a2d594ca6 tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:39:33.997463 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-fa31f1d7-8b88-44e9-82a6-006a2d594ca6 tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] [instance: 732ab305-73a0-4a03-b0b7-d8f587f1654b] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:39:34.000539 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG dbcounter [-] [129350] Writing DB stats nova_api:SELECT=54 {{(pid=129350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 10:39:34.004726 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-fa31f1d7-8b88-44e9-82a6-006a2d594ca6 tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:39:34.005173 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-fa31f1d7-8b88-44e9-82a6-006a2d594ca6 tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:39:34.005968 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-fa31f1d7-8b88-44e9-82a6-006a2d594ca6 tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:39:34.006404 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-fa31f1d7-8b88-44e9-82a6-006a2d594ca6 tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:39:34.168742 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-fa31f1d7-8b88-44e9-82a6-006a2d594ca6 tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '446b13b4661542c097afafb32443dae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3b18ee23fb548709fc513c7e1cfe623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:39:34.177378 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-fa31f1d7-8b88-44e9-82a6-006a2d594ca6 tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] 10.222.0.42 "GET /compute/v2.1/servers/732ab305-73a0-4a03-b0b7-d8f587f1654b" status: 200 len: 1314 microversion: 2.1 time: 0.184477 Jun 06 10:39:34.178248 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 91/188] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:39:33 2022] GET /compute/v2.1/servers/732ab305-73a0-4a03-b0b7-d8f587f1654b => generated 1314 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:39:34.268494 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [req-0fd2101e-f8c4-4ca4-8a2a-f5b5f030f835 req-10ef098b-d600-453e-930b-a909460ae6fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "732ab305-73a0-4a03-b0b7-d8f587f1654b", "name": "network-vif-plugged", "status": "completed", "tag": "6defd997-423f-4a99-b1dd-b66c7aa6d4dd"}]} {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 10:39:34.277856 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [req-0fd2101e-f8c4-4ca4-8a2a-f5b5f030f835 req-10ef098b-d600-453e-930b-a909460ae6fb service nova] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:39:34.278745 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [req-0fd2101e-f8c4-4ca4-8a2a-f5b5f030f835 req-10ef098b-d600-453e-930b-a909460ae6fb service nova] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:39:34.294761 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.compute.server_external_events [req-0fd2101e-f8c4-4ca4-8a2a-f5b5f030f835 req-10ef098b-d600-453e-930b-a909460ae6fb service nova] Creating event network-vif-plugged:6defd997-423f-4a99-b1dd-b66c7aa6d4dd for instance 732ab305-73a0-4a03-b0b7-d8f587f1654b on hv-cinder-84482 Jun 06 10:39:34.300394 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [req-0fd2101e-f8c4-4ca4-8a2a-f5b5f030f835 req-10ef098b-d600-453e-930b-a909460ae6fb service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035808 Jun 06 10:39:34.301285 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 98/189] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Jun 6 10:39:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 10:39:34.359970 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-34c727ef-40ca-44a8-9afe-5c4d1acbfe8d tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:39:34.360722 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-34c727ef-40ca-44a8-9afe-5c4d1acbfe8d tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] [instance: 6345448b-01b7-4429-bb10-fc5ae449ef71] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:39:34.372024 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-34c727ef-40ca-44a8-9afe-5c4d1acbfe8d tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:39:34.372705 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-34c727ef-40ca-44a8-9afe-5c4d1acbfe8d tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:39:34.373788 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-34c727ef-40ca-44a8-9afe-5c4d1acbfe8d tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:39:34.374362 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-34c727ef-40ca-44a8-9afe-5c4d1acbfe8d tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:39:34.547375 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-34c727ef-40ca-44a8-9afe-5c4d1acbfe8d tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f269e146c844480c822347c3a38d103b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2b17b61b73b4e6d81dd8ffe9cf311ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:39:34.557118 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-34c727ef-40ca-44a8-9afe-5c4d1acbfe8d tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] 10.222.0.42 "GET /compute/v2.1/servers/6345448b-01b7-4429-bb10-fc5ae449ef71" status: 200 len: 1522 microversion: 2.1 time: 0.202545 Jun 06 10:39:34.558769 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 92/190] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:39:34 2022] GET /compute/v2.1/servers/6345448b-01b7-4429-bb10-fc5ae449ef71 => generated 1522 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:39:35.196759 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-ad75f080-b831-4281-aebb-81ba423eaa2b tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:39:35.197513 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-ad75f080-b831-4281-aebb-81ba423eaa2b tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] [instance: 732ab305-73a0-4a03-b0b7-d8f587f1654b] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:39:35.204785 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-ad75f080-b831-4281-aebb-81ba423eaa2b tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:39:35.205284 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-ad75f080-b831-4281-aebb-81ba423eaa2b tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:39:35.206092 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-ad75f080-b831-4281-aebb-81ba423eaa2b tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:39:35.206524 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-ad75f080-b831-4281-aebb-81ba423eaa2b tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:39:35.348719 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-ad75f080-b831-4281-aebb-81ba423eaa2b tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '446b13b4661542c097afafb32443dae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3b18ee23fb548709fc513c7e1cfe623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:39:35.357474 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-ad75f080-b831-4281-aebb-81ba423eaa2b tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] 10.222.0.42 "GET /compute/v2.1/servers/732ab305-73a0-4a03-b0b7-d8f587f1654b" status: 200 len: 1314 microversion: 2.1 time: 0.165638 Jun 06 10:39:35.358034 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 99/191] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:39:35 2022] GET /compute/v2.1/servers/732ab305-73a0-4a03-b0b7-d8f587f1654b => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:39:35.575501 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-bd2adf48-f0fc-4a46-9e8a-3ccdb8a51c93 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:39:35.576142 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-bd2adf48-f0fc-4a46-9e8a-3ccdb8a51c93 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] [instance: 6345448b-01b7-4429-bb10-fc5ae449ef71] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:39:35.582128 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-bd2adf48-f0fc-4a46-9e8a-3ccdb8a51c93 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:39:35.582677 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-bd2adf48-f0fc-4a46-9e8a-3ccdb8a51c93 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:39:35.583450 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-bd2adf48-f0fc-4a46-9e8a-3ccdb8a51c93 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:39:35.583928 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-bd2adf48-f0fc-4a46-9e8a-3ccdb8a51c93 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:39:35.588476 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG dbcounter [-] [129350] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 10:39:35.802476 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-bd2adf48-f0fc-4a46-9e8a-3ccdb8a51c93 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f269e146c844480c822347c3a38d103b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2b17b61b73b4e6d81dd8ffe9cf311ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:39:35.816059 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-bd2adf48-f0fc-4a46-9e8a-3ccdb8a51c93 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] 10.222.0.42 "GET /compute/v2.1/servers/6345448b-01b7-4429-bb10-fc5ae449ef71" status: 200 len: 1522 microversion: 2.1 time: 0.244507 Jun 06 10:39:35.821384 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 93/192] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:39:35 2022] GET /compute/v2.1/servers/6345448b-01b7-4429-bb10-fc5ae449ef71 => generated 1522 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:39:36.375897 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-0fadf39c-8800-4ddf-a12d-267d9fc4ed6a tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:39:36.377726 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-0fadf39c-8800-4ddf-a12d-267d9fc4ed6a tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] [instance: 732ab305-73a0-4a03-b0b7-d8f587f1654b] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:39:36.386224 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-0fadf39c-8800-4ddf-a12d-267d9fc4ed6a tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:39:36.386672 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-0fadf39c-8800-4ddf-a12d-267d9fc4ed6a tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:39:36.387640 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-0fadf39c-8800-4ddf-a12d-267d9fc4ed6a tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:39:36.388091 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-0fadf39c-8800-4ddf-a12d-267d9fc4ed6a tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:39:36.521440 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-0fadf39c-8800-4ddf-a12d-267d9fc4ed6a tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '446b13b4661542c097afafb32443dae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3b18ee23fb548709fc513c7e1cfe623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:39:36.529154 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-0fadf39c-8800-4ddf-a12d-267d9fc4ed6a tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] 10.222.0.42 "GET /compute/v2.1/servers/732ab305-73a0-4a03-b0b7-d8f587f1654b" status: 200 len: 1499 microversion: 2.1 time: 0.158688 Jun 06 10:39:36.529804 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 100/193] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:39:36 2022] GET /compute/v2.1/servers/732ab305-73a0-4a03-b0b7-d8f587f1654b => generated 1499 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:39:36.838486 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-afd28b01-a596-4286-a8b1-51a63398dceb tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:39:36.839469 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-afd28b01-a596-4286-a8b1-51a63398dceb tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] [instance: 6345448b-01b7-4429-bb10-fc5ae449ef71] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:39:36.846120 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-afd28b01-a596-4286-a8b1-51a63398dceb tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:39:36.846562 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-afd28b01-a596-4286-a8b1-51a63398dceb tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:39:36.847471 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-afd28b01-a596-4286-a8b1-51a63398dceb tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:39:36.847972 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-afd28b01-a596-4286-a8b1-51a63398dceb tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:39:36.991277 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-afd28b01-a596-4286-a8b1-51a63398dceb tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f269e146c844480c822347c3a38d103b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2b17b61b73b4e6d81dd8ffe9cf311ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:39:36.999479 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-afd28b01-a596-4286-a8b1-51a63398dceb tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] 10.222.0.42 "GET /compute/v2.1/servers/6345448b-01b7-4429-bb10-fc5ae449ef71" status: 200 len: 1522 microversion: 2.1 time: 0.164828 Jun 06 10:39:37.000062 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 94/194] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:39:36 2022] GET /compute/v2.1/servers/6345448b-01b7-4429-bb10-fc5ae449ef71 => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:39:38.016980 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-15640952-0171-48f5-b909-a43f191e8ea1 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:39:38.017674 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-15640952-0171-48f5-b909-a43f191e8ea1 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] [instance: 6345448b-01b7-4429-bb10-fc5ae449ef71] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:39:38.025404 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-15640952-0171-48f5-b909-a43f191e8ea1 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:39:38.025918 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-15640952-0171-48f5-b909-a43f191e8ea1 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:39:38.026773 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-15640952-0171-48f5-b909-a43f191e8ea1 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:39:38.027292 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-15640952-0171-48f5-b909-a43f191e8ea1 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:39:38.207992 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-15640952-0171-48f5-b909-a43f191e8ea1 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f269e146c844480c822347c3a38d103b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2b17b61b73b4e6d81dd8ffe9cf311ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:39:38.217487 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-15640952-0171-48f5-b909-a43f191e8ea1 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] 10.222.0.42 "GET /compute/v2.1/servers/6345448b-01b7-4429-bb10-fc5ae449ef71" status: 200 len: 1522 microversion: 2.1 time: 0.204159 Jun 06 10:39:38.218220 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 101/195] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:39:38 2022] GET /compute/v2.1/servers/6345448b-01b7-4429-bb10-fc5ae449ef71 => generated 1522 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:39:39.234229 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-03519c2d-01dd-4393-9605-86747b3ad61d tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:39:39.234845 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-03519c2d-01dd-4393-9605-86747b3ad61d tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] [instance: 6345448b-01b7-4429-bb10-fc5ae449ef71] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:39:39.241201 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-03519c2d-01dd-4393-9605-86747b3ad61d tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:39:39.241911 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-03519c2d-01dd-4393-9605-86747b3ad61d tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:39:39.242754 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-03519c2d-01dd-4393-9605-86747b3ad61d tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:39:39.243441 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-03519c2d-01dd-4393-9605-86747b3ad61d tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:39:39.406419 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-03519c2d-01dd-4393-9605-86747b3ad61d tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f269e146c844480c822347c3a38d103b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2b17b61b73b4e6d81dd8ffe9cf311ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:39:39.415543 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-03519c2d-01dd-4393-9605-86747b3ad61d tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] 10.222.0.42 "GET /compute/v2.1/servers/6345448b-01b7-4429-bb10-fc5ae449ef71" status: 200 len: 1522 microversion: 2.1 time: 0.185110 Jun 06 10:39:39.416206 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 95/196] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:39:39 2022] GET /compute/v2.1/servers/6345448b-01b7-4429-bb10-fc5ae449ef71 => generated 1522 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:39:39.528220 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-5ba15f25-1860-45c0-a0a4-f3f772bca743 tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:39:39.528722 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-5ba15f25-1860-45c0-a0a4-f3f772bca743 tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] [instance: 732ab305-73a0-4a03-b0b7-d8f587f1654b] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:39:39.541043 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-5ba15f25-1860-45c0-a0a4-f3f772bca743 tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:39:39.542372 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-5ba15f25-1860-45c0-a0a4-f3f772bca743 tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:39:39.543634 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-5ba15f25-1860-45c0-a0a4-f3f772bca743 tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:39:39.544107 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-5ba15f25-1860-45c0-a0a4-f3f772bca743 tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:39:39.572148 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-5ba15f25-1860-45c0-a0a4-f3f772bca743 tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] [instance: 732ab305-73a0-4a03-b0b7-d8f587f1654b] Going to try to terminate instance {{(pid=129349) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 06 10:39:39.671046 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-5ba15f25-1860-45c0-a0a4-f3f772bca743 tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] 10.222.0.42 "DELETE /compute/v2.1/servers/732ab305-73a0-4a03-b0b7-d8f587f1654b" status: 204 len: 0 microversion: 2.1 time: 0.144740 Jun 06 10:39:39.671046 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 102/197] 10.222.0.42 () {58 vars in 1238 bytes} [Mon Jun 6 10:39:39 2022] DELETE /compute/v2.1/servers/732ab305-73a0-4a03-b0b7-d8f587f1654b => generated 0 bytes in 147 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 06 10:39:39.678250 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-f50a813e-d61b-4ba8-a45d-525a427b2345 tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:39:39.679265 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-f50a813e-d61b-4ba8-a45d-525a427b2345 tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] [instance: 732ab305-73a0-4a03-b0b7-d8f587f1654b] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:39:39.686483 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-f50a813e-d61b-4ba8-a45d-525a427b2345 tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:39:39.687097 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-f50a813e-d61b-4ba8-a45d-525a427b2345 tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:39:39.687888 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-f50a813e-d61b-4ba8-a45d-525a427b2345 tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:39:39.688320 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-f50a813e-d61b-4ba8-a45d-525a427b2345 tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:39:39.838161 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-f50a813e-d61b-4ba8-a45d-525a427b2345 tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '446b13b4661542c097afafb32443dae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3b18ee23fb548709fc513c7e1cfe623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:39:39.845764 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-f50a813e-d61b-4ba8-a45d-525a427b2345 tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] 10.222.0.42 "GET /compute/v2.1/servers/732ab305-73a0-4a03-b0b7-d8f587f1654b" status: 200 len: 1505 microversion: 2.1 time: 0.171422 Jun 06 10:39:39.846325 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 96/198] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:39:39 2022] GET /compute/v2.1/servers/732ab305-73a0-4a03-b0b7-d8f587f1654b => generated 1505 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 10:39:40.436778 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-a627d2ea-c136-4f0e-b871-20eaf59881f4 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:39:40.437479 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-a627d2ea-c136-4f0e-b871-20eaf59881f4 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] [instance: 6345448b-01b7-4429-bb10-fc5ae449ef71] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:39:40.443422 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-a627d2ea-c136-4f0e-b871-20eaf59881f4 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:39:40.443907 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-a627d2ea-c136-4f0e-b871-20eaf59881f4 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:39:40.444669 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-a627d2ea-c136-4f0e-b871-20eaf59881f4 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:39:40.445100 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-a627d2ea-c136-4f0e-b871-20eaf59881f4 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:39:40.460306 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG dbcounter [-] [129349] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 10:39:40.595268 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-a627d2ea-c136-4f0e-b871-20eaf59881f4 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f269e146c844480c822347c3a38d103b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2b17b61b73b4e6d81dd8ffe9cf311ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:39:40.603193 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-a627d2ea-c136-4f0e-b871-20eaf59881f4 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] 10.222.0.42 "GET /compute/v2.1/servers/6345448b-01b7-4429-bb10-fc5ae449ef71" status: 200 len: 1522 microversion: 2.1 time: 0.171135 Jun 06 10:39:40.603684 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 103/199] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:39:40 2022] GET /compute/v2.1/servers/6345448b-01b7-4429-bb10-fc5ae449ef71 => generated 1522 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 10:39:40.862763 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-e2cede8f-b022-4468-9d29-b7767ae93e27 tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:39:40.863373 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-e2cede8f-b022-4468-9d29-b7767ae93e27 tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] [instance: 732ab305-73a0-4a03-b0b7-d8f587f1654b] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:39:40.869372 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-e2cede8f-b022-4468-9d29-b7767ae93e27 tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:39:40.870496 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-e2cede8f-b022-4468-9d29-b7767ae93e27 tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:39:40.871547 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-e2cede8f-b022-4468-9d29-b7767ae93e27 tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:39:40.872181 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-e2cede8f-b022-4468-9d29-b7767ae93e27 tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:39:41.076445 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-e2cede8f-b022-4468-9d29-b7767ae93e27 tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '446b13b4661542c097afafb32443dae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3b18ee23fb548709fc513c7e1cfe623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:39:41.083859 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-e2cede8f-b022-4468-9d29-b7767ae93e27 tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] 10.222.0.42 "GET /compute/v2.1/servers/732ab305-73a0-4a03-b0b7-d8f587f1654b" status: 200 len: 1505 microversion: 2.1 time: 0.224696 Jun 06 10:39:41.084424 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 97/200] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:39:40 2022] GET /compute/v2.1/servers/732ab305-73a0-4a03-b0b7-d8f587f1654b => generated 1505 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:39:41.624690 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-2c3652d0-3912-4d7f-b51d-4bc1d1d27c9d tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:39:41.625872 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-2c3652d0-3912-4d7f-b51d-4bc1d1d27c9d tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] [instance: 6345448b-01b7-4429-bb10-fc5ae449ef71] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:39:41.633873 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-2c3652d0-3912-4d7f-b51d-4bc1d1d27c9d tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:39:41.634325 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-2c3652d0-3912-4d7f-b51d-4bc1d1d27c9d tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:39:41.635116 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-2c3652d0-3912-4d7f-b51d-4bc1d1d27c9d tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:39:41.636430 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-2c3652d0-3912-4d7f-b51d-4bc1d1d27c9d tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:39:41.781166 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-2c3652d0-3912-4d7f-b51d-4bc1d1d27c9d tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f269e146c844480c822347c3a38d103b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2b17b61b73b4e6d81dd8ffe9cf311ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:39:41.788695 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-2c3652d0-3912-4d7f-b51d-4bc1d1d27c9d tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] 10.222.0.42 "GET /compute/v2.1/servers/6345448b-01b7-4429-bb10-fc5ae449ef71" status: 200 len: 1522 microversion: 2.1 time: 0.171230 Jun 06 10:39:41.791938 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 104/201] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:39:41 2022] GET /compute/v2.1/servers/6345448b-01b7-4429-bb10-fc5ae449ef71 => generated 1522 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:39:42.100365 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-84662803-2bf3-45e9-b28c-5352dfdd2c82 tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:39:42.101101 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-84662803-2bf3-45e9-b28c-5352dfdd2c82 tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] [instance: 732ab305-73a0-4a03-b0b7-d8f587f1654b] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:39:42.107824 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-84662803-2bf3-45e9-b28c-5352dfdd2c82 tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:39:42.108264 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-84662803-2bf3-45e9-b28c-5352dfdd2c82 tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:39:42.109013 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-84662803-2bf3-45e9-b28c-5352dfdd2c82 tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:39:42.109437 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-84662803-2bf3-45e9-b28c-5352dfdd2c82 tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:39:42.241955 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-84662803-2bf3-45e9-b28c-5352dfdd2c82 tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '446b13b4661542c097afafb32443dae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3b18ee23fb548709fc513c7e1cfe623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:39:42.249557 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-84662803-2bf3-45e9-b28c-5352dfdd2c82 tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] 10.222.0.42 "GET /compute/v2.1/servers/732ab305-73a0-4a03-b0b7-d8f587f1654b" status: 200 len: 1505 microversion: 2.1 time: 0.153093 Jun 06 10:39:42.250111 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 98/202] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:39:42 2022] GET /compute/v2.1/servers/732ab305-73a0-4a03-b0b7-d8f587f1654b => generated 1505 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:39:42.806125 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-7cda6950-667c-4425-b6a5-85f3d45e88d4 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:39:42.806728 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-7cda6950-667c-4425-b6a5-85f3d45e88d4 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] [instance: 6345448b-01b7-4429-bb10-fc5ae449ef71] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:39:42.813844 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-7cda6950-667c-4425-b6a5-85f3d45e88d4 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:39:42.814285 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-7cda6950-667c-4425-b6a5-85f3d45e88d4 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:39:42.815044 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-7cda6950-667c-4425-b6a5-85f3d45e88d4 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:39:42.815470 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-7cda6950-667c-4425-b6a5-85f3d45e88d4 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:39:42.953820 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-7cda6950-667c-4425-b6a5-85f3d45e88d4 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f269e146c844480c822347c3a38d103b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2b17b61b73b4e6d81dd8ffe9cf311ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:39:42.961475 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-7cda6950-667c-4425-b6a5-85f3d45e88d4 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] 10.222.0.42 "GET /compute/v2.1/servers/6345448b-01b7-4429-bb10-fc5ae449ef71" status: 200 len: 1522 microversion: 2.1 time: 0.159377 Jun 06 10:39:42.962043 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 105/203] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:39:42 2022] GET /compute/v2.1/servers/6345448b-01b7-4429-bb10-fc5ae449ef71 => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:39:43.267607 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-620ec953-0879-4ae6-a02c-a4be7ba1d509 tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:39:43.268277 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-620ec953-0879-4ae6-a02c-a4be7ba1d509 tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] [instance: 732ab305-73a0-4a03-b0b7-d8f587f1654b] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:39:43.275086 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-620ec953-0879-4ae6-a02c-a4be7ba1d509 tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:39:43.275832 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-620ec953-0879-4ae6-a02c-a4be7ba1d509 tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:39:43.277192 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-620ec953-0879-4ae6-a02c-a4be7ba1d509 tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:39:43.277949 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-620ec953-0879-4ae6-a02c-a4be7ba1d509 tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:39:43.516147 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-620ec953-0879-4ae6-a02c-a4be7ba1d509 tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '446b13b4661542c097afafb32443dae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3b18ee23fb548709fc513c7e1cfe623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:39:43.535829 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-620ec953-0879-4ae6-a02c-a4be7ba1d509 tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] 10.222.0.42 "GET /compute/v2.1/servers/732ab305-73a0-4a03-b0b7-d8f587f1654b" status: 200 len: 1505 microversion: 2.1 time: 0.272120 Jun 06 10:39:43.537729 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 99/204] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:39:43 2022] GET /compute/v2.1/servers/732ab305-73a0-4a03-b0b7-d8f587f1654b => generated 1505 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:39:43.980013 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-5471119f-3499-41e2-988a-40187b4ff322 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:39:43.980713 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-5471119f-3499-41e2-988a-40187b4ff322 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] [instance: 6345448b-01b7-4429-bb10-fc5ae449ef71] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:39:43.994093 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [req-34b88771-b64c-4e81-8e3a-4d73e242c234 req-91f919bc-87d7-4142-9f7d-fff3be2ead1a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "732ab305-73a0-4a03-b0b7-d8f587f1654b", "name": "network-vif-deleted", "tag": "6defd997-423f-4a99-b1dd-b66c7aa6d4dd"}]} {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 10:39:43.997405 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-5471119f-3499-41e2-988a-40187b4ff322 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:39:43.997872 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-5471119f-3499-41e2-988a-40187b4ff322 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:39:43.998660 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-5471119f-3499-41e2-988a-40187b4ff322 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:39:43.999099 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-5471119f-3499-41e2-988a-40187b4ff322 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:39:44.004387 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [req-34b88771-b64c-4e81-8e3a-4d73e242c234 req-91f919bc-87d7-4142-9f7d-fff3be2ead1a service nova] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:39:44.005101 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [req-34b88771-b64c-4e81-8e3a-4d73e242c234 req-91f919bc-87d7-4142-9f7d-fff3be2ead1a service nova] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:39:44.022843 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.compute.server_external_events [req-34b88771-b64c-4e81-8e3a-4d73e242c234 req-91f919bc-87d7-4142-9f7d-fff3be2ead1a service nova] Creating event network-vif-deleted:6defd997-423f-4a99-b1dd-b66c7aa6d4dd for instance 732ab305-73a0-4a03-b0b7-d8f587f1654b on hv-cinder-84482 Jun 06 10:39:44.032142 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [req-34b88771-b64c-4e81-8e3a-4d73e242c234 req-91f919bc-87d7-4142-9f7d-fff3be2ead1a service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041466 Jun 06 10:39:44.036300 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 100/205] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Jun 6 10:39:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 06 10:39:44.150143 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-5471119f-3499-41e2-988a-40187b4ff322 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f269e146c844480c822347c3a38d103b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2b17b61b73b4e6d81dd8ffe9cf311ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:39:44.158752 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-5471119f-3499-41e2-988a-40187b4ff322 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] 10.222.0.42 "GET /compute/v2.1/servers/6345448b-01b7-4429-bb10-fc5ae449ef71" status: 200 len: 1522 microversion: 2.1 time: 0.183327 Jun 06 10:39:44.160125 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 106/206] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:39:43 2022] GET /compute/v2.1/servers/6345448b-01b7-4429-bb10-fc5ae449ef71 => generated 1522 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:39:44.556292 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-b724b4ed-51b4-46a7-852a-d2e3e5b1a8b1 tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:39:44.557016 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-b724b4ed-51b4-46a7-852a-d2e3e5b1a8b1 tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] [instance: 732ab305-73a0-4a03-b0b7-d8f587f1654b] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:39:44.563465 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-b724b4ed-51b4-46a7-852a-d2e3e5b1a8b1 tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:39:44.564013 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-b724b4ed-51b4-46a7-852a-d2e3e5b1a8b1 tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:39:44.564768 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-b724b4ed-51b4-46a7-852a-d2e3e5b1a8b1 tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:39:44.565226 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-b724b4ed-51b4-46a7-852a-d2e3e5b1a8b1 tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:39:44.597166 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-b724b4ed-51b4-46a7-852a-d2e3e5b1a8b1 tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:39:44.597588 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-b724b4ed-51b4-46a7-852a-d2e3e5b1a8b1 tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:39:44.598025 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.objects.instance [None req-b724b4ed-51b4-46a7-852a-d2e3e5b1a8b1 tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] Lazy-loading 'fault' on Instance uuid 732ab305-73a0-4a03-b0b7-d8f587f1654b {{(pid=129350) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 06 10:39:44.647680 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-b724b4ed-51b4-46a7-852a-d2e3e5b1a8b1 tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '446b13b4661542c097afafb32443dae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3b18ee23fb548709fc513c7e1cfe623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:39:44.654945 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-b724b4ed-51b4-46a7-852a-d2e3e5b1a8b1 tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] 10.222.0.42 "GET /compute/v2.1/servers/732ab305-73a0-4a03-b0b7-d8f587f1654b" status: 200 len: 1304 microversion: 2.1 time: 0.102951 Jun 06 10:39:44.655508 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 101/207] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:39:44 2022] GET /compute/v2.1/servers/732ab305-73a0-4a03-b0b7-d8f587f1654b => generated 1304 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:39:45.177176 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-fd2aaf88-fe89-456a-a59b-1f10f3ea2b7c tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:39:45.177793 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-fd2aaf88-fe89-456a-a59b-1f10f3ea2b7c tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] [instance: 6345448b-01b7-4429-bb10-fc5ae449ef71] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:39:45.188001 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-fd2aaf88-fe89-456a-a59b-1f10f3ea2b7c tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:39:45.188659 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-fd2aaf88-fe89-456a-a59b-1f10f3ea2b7c tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:39:45.189608 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-fd2aaf88-fe89-456a-a59b-1f10f3ea2b7c tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:39:45.190256 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-fd2aaf88-fe89-456a-a59b-1f10f3ea2b7c tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:39:45.348673 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-fd2aaf88-fe89-456a-a59b-1f10f3ea2b7c tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f269e146c844480c822347c3a38d103b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2b17b61b73b4e6d81dd8ffe9cf311ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:39:45.358642 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-fd2aaf88-fe89-456a-a59b-1f10f3ea2b7c tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] 10.222.0.42 "GET /compute/v2.1/servers/6345448b-01b7-4429-bb10-fc5ae449ef71" status: 200 len: 1522 microversion: 2.1 time: 0.185356 Jun 06 10:39:45.359416 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 107/208] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:39:45 2022] GET /compute/v2.1/servers/6345448b-01b7-4429-bb10-fc5ae449ef71 => generated 1522 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:39:45.672514 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-a9095f53-935e-4744-86de-3992b6dae5a3 tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:39:45.673351 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-a9095f53-935e-4744-86de-3992b6dae5a3 tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] [instance: 732ab305-73a0-4a03-b0b7-d8f587f1654b] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:39:45.679334 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-a9095f53-935e-4744-86de-3992b6dae5a3 tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:39:45.679827 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-a9095f53-935e-4744-86de-3992b6dae5a3 tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:39:45.680596 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-a9095f53-935e-4744-86de-3992b6dae5a3 tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:39:45.681029 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-a9095f53-935e-4744-86de-3992b6dae5a3 tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:39:45.694084 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.wsgi [None req-a9095f53-935e-4744-86de-3992b6dae5a3 tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] HTTP exception thrown: Instance 732ab305-73a0-4a03-b0b7-d8f587f1654b could not be found. Jun 06 10:39:45.695746 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-a9095f53-935e-4744-86de-3992b6dae5a3 tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] Request method failure captured: Jun 06 10:39:45.695746 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: request: GET /compute/v2.1/servers/732ab305-73a0-4a03-b0b7-d8f587f1654b HTTP/1.1 Jun 06 10:39:45.695746 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: Accept: application/json Jun 06 10:39:45.695746 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: Accept-Encoding: identity Jun 06 10:39:45.695746 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: Connection: close Jun 06 10:39:45.695746 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: Content-Length: 0 Jun 06 10:39:45.695746 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: Content-Type: application/json Jun 06 10:39:45.695746 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: Host: 10.222.0.42 Jun 06 10:39:45.695746 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: Openstack-System-Scope: None Jun 06 10:39:45.695746 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: User-Agent: python-urllib3/1.26.9 Jun 06 10:39:45.695746 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Auth-Token: gAAAAABindlTmMmKURqxAThEr20DIZo-50DAUNsGyKrXEJEOhhSwHuNvioaK_PXKLhf6ygxQLHoYb1RflIucd4kfAn4hWm07mgHV8oRtM5QUL0VwdWFBVRnUSQYoVxLxV3O-gLuxqor80eoHvP7WqCL7jrQ3a32In_nlLkOTwuhh2IpMLlPubpI Jun 06 10:39:45.695746 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Domain-Id: None Jun 06 10:39:45.695746 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Domain-Name: None Jun 06 10:39:45.695746 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Identity-Status: Confirmed Jun 06 10:39:45.695746 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Is-Admin-Project: True Jun 06 10:39:45.695746 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Project-Domain-Id: default Jun 06 10:39:45.695746 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Project-Domain-Name: Default Jun 06 10:39:45.695746 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Project-Id: b3b18ee23fb548709fc513c7e1cfe623 Jun 06 10:39:45.695746 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Project-Name: tempest-VolumesActionsTest-595691019 Jun 06 10:39:45.695746 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Role: member,reader Jun 06 10:39:45.695746 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Roles: member,reader Jun 06 10:39:45.697320 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/b3b18ee23fb548709fc513c7e1cfe623"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b3b18ee23fb548709fc513c7e1cfe623"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b3b18ee23fb548709fc513c7e1cfe623"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_b3b18ee23fb548709fc513c7e1cfe623", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Jun 06 10:39:45.697320 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Tenant: tempest-VolumesActionsTest-595691019 Jun 06 10:39:45.697320 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Tenant-Id: b3b18ee23fb548709fc513c7e1cfe623 Jun 06 10:39:45.697320 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Tenant-Name: tempest-VolumesActionsTest-595691019 Jun 06 10:39:45.697320 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-User: tempest-VolumesActionsTest-595691019-project Jun 06 10:39:45.697320 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-User-Domain-Id: default Jun 06 10:39:45.697320 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-User-Domain-Name: Default Jun 06 10:39:45.697320 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-User-Id: 446b13b4661542c097afafb32443dae4 Jun 06 10:39:45.697320 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-User-Name: tempest-VolumesActionsTest-595691019-project Jun 06 10:39:45.697320 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: method: > Jun 06 10:39:45.697320 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: exception: Instance 732ab305-73a0-4a03-b0b7-d8f587f1654b could not be found. Jun 06 10:39:45.697320 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: action_args: {'id': '732ab305-73a0-4a03-b0b7-d8f587f1654b'} Jun 06 10:39:45.698708 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 10:39:45.698708 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 10:39:45.698708 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 06 10:39:45.698708 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 06 10:39:45.698708 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 06 10:39:45.698708 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 06 10:39:45.698708 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 06 10:39:45.698708 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 06 10:39:45.698708 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 06 10:39:45.698708 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 06 10:39:45.698708 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 732ab305-73a0-4a03-b0b7-d8f587f1654b could not be found. Jun 06 10:39:45.698708 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi Jun 06 10:39:45.698708 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 10:39:45.698708 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi Jun 06 10:39:45.698708 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 10:39:45.698708 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 10:39:45.698708 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 10:39:45.698708 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 10:39:45.698708 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 10:39:45.698708 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 10:39:45.700206 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 10:39:45.700206 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 06 10:39:45.700206 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 06 10:39:45.700206 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 06 10:39:45.700206 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 06 10:39:45.700206 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 06 10:39:45.700206 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 06 10:39:45.700206 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 732ab305-73a0-4a03-b0b7-d8f587f1654b could not be found. Jun 06 10:39:45.700206 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi Jun 06 10:39:45.700206 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 10:39:45.700206 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi Jun 06 10:39:45.700206 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 10:39:45.700206 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 10:39:45.700206 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 10:39:45.700206 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 10:39:45.700206 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 10:39:45.700206 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 732ab305-73a0-4a03-b0b7-d8f587f1654b could not be found. Jun 06 10:39:45.700206 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi Jun 06 10:39:45.701430 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-a9095f53-935e-4744-86de-3992b6dae5a3 tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] Returning 404 to user: Instance 732ab305-73a0-4a03-b0b7-d8f587f1654b could not be found. {{(pid=129350) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 10:39:45.701430 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-a9095f53-935e-4744-86de-3992b6dae5a3 tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] 10.222.0.42 "GET /compute/v2.1/servers/732ab305-73a0-4a03-b0b7-d8f587f1654b" status: 404 len: 111 microversion: 2.1 time: 0.028686 Jun 06 10:39:45.701430 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 102/209] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:39:45 2022] GET /compute/v2.1/servers/732ab305-73a0-4a03-b0b7-d8f587f1654b => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 06 10:39:45.811266 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-675184f2-b314-4147-bb19-f495f439ef85 tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-827294198", "imageRef": "6eea2d98-354d-4083-b74c-abcbb97f9e1a", "flavorRef": "452", "networks": [{"uuid": "ddf7599b-79d9-4e2b-be8b-aaed763d0ad2"}]}} {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 10:39:45.865178 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.network.neutron [None req-675184f2-b314-4147-bb19-f495f439ef85 tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] validate_networks() for [('ddf7599b-79d9-4e2b-be8b-aaed763d0ad2', None, None, None, None, None)] {{(pid=129349) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 06 10:39:46.243077 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.virt.hardware [None req-675184f2-b314-4147-bb19-f495f439ef85 tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] Flavor limits 0:0:0 {{(pid=129349) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 06 10:39:46.243719 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.virt.hardware [None req-675184f2-b314-4147-bb19-f495f439ef85 tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] Image limits 0:0:0 {{(pid=129349) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 06 10:39:46.245224 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.virt.hardware [None req-675184f2-b314-4147-bb19-f495f439ef85 tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] Flavor pref 0:0:0 {{(pid=129349) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 06 10:39:46.245640 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.virt.hardware [None req-675184f2-b314-4147-bb19-f495f439ef85 tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] Image pref 0:0:0 {{(pid=129349) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 06 10:39:46.246052 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.virt.hardware [None req-675184f2-b314-4147-bb19-f495f439ef85 tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129349) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 06 10:39:46.256266 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-675184f2-b314-4147-bb19-f495f439ef85 tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:39:46.256720 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-675184f2-b314-4147-bb19-f495f439ef85 tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:39:46.257517 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-675184f2-b314-4147-bb19-f495f439ef85 tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:39:46.257948 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-675184f2-b314-4147-bb19-f495f439ef85 tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:39:46.275939 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.quota [None req-675184f2-b314-4147-bb19-f495f439ef85 tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] Getting quotas for project b3b18ee23fb548709fc513c7e1cfe623. Resources: {'ram', 'cores', 'instances'} {{(pid=129349) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 06 10:39:46.281050 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.quota [None req-675184f2-b314-4147-bb19-f495f439ef85 tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] Getting quotas for user 446b13b4661542c097afafb32443dae4 and project b3b18ee23fb548709fc513c7e1cfe623. Resources: {'ram', 'cores', 'instances'} {{(pid=129349) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 06 10:39:46.295103 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-675184f2-b314-4147-bb19-f495f439ef85 tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] Going to run 1 instances... {{(pid=129349) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 06 10:39:46.297403 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-675184f2-b314-4147-bb19-f495f439ef85 tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] [instance: 9063a59c-4c5f-4e65-8fd8-ffc525024f22] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6eea2d98-354d-4083-b74c-abcbb97f9e1a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129349) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 06 10:39:46.356350 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-675184f2-b314-4147-bb19-f495f439ef85 tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.548396 Jun 06 10:39:46.357100 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 108/210] 10.222.0.42 () {60 vars in 1146 bytes} [Mon Jun 6 10:39:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 550 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 06 10:39:46.372012 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-2bab1823-ec87-4651-8457-128f85ac0980 tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:39:46.372839 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-2bab1823-ec87-4651-8457-128f85ac0980 tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] [instance: 9063a59c-4c5f-4e65-8fd8-ffc525024f22] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:39:46.384860 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-d50c1b55-4d6b-4aeb-bf2f-5df3a66a393e tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:39:46.386452 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-d50c1b55-4d6b-4aeb-bf2f-5df3a66a393e tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] [instance: 6345448b-01b7-4429-bb10-fc5ae449ef71] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:39:46.398609 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-d50c1b55-4d6b-4aeb-bf2f-5df3a66a393e tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:39:46.399612 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-d50c1b55-4d6b-4aeb-bf2f-5df3a66a393e tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:39:46.401215 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-d50c1b55-4d6b-4aeb-bf2f-5df3a66a393e tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:39:46.401917 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-d50c1b55-4d6b-4aeb-bf2f-5df3a66a393e tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:39:46.452499 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-2bab1823-ec87-4651-8457-128f85ac0980 tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '446b13b4661542c097afafb32443dae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3b18ee23fb548709fc513c7e1cfe623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:39:46.460689 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-2bab1823-ec87-4651-8457-128f85ac0980 tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] 10.222.0.42 "GET /compute/v2.1/servers/9063a59c-4c5f-4e65-8fd8-ffc525024f22" status: 200 len: 1213 microversion: 2.1 time: 0.095080 Jun 06 10:39:46.461877 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 103/211] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:39:46 2022] GET /compute/v2.1/servers/9063a59c-4c5f-4e65-8fd8-ffc525024f22 => generated 1213 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:39:46.568576 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-d50c1b55-4d6b-4aeb-bf2f-5df3a66a393e tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f269e146c844480c822347c3a38d103b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2b17b61b73b4e6d81dd8ffe9cf311ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:39:46.577360 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-d50c1b55-4d6b-4aeb-bf2f-5df3a66a393e tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] 10.222.0.42 "GET /compute/v2.1/servers/6345448b-01b7-4429-bb10-fc5ae449ef71" status: 200 len: 1522 microversion: 2.1 time: 0.196328 Jun 06 10:39:46.577952 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 109/212] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:39:46 2022] GET /compute/v2.1/servers/6345448b-01b7-4429-bb10-fc5ae449ef71 => generated 1522 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:39:47.478215 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-37f988dd-7a8e-425b-87de-4fe7ec36b9cb tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:39:47.480229 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-37f988dd-7a8e-425b-87de-4fe7ec36b9cb tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] [instance: 9063a59c-4c5f-4e65-8fd8-ffc525024f22] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:39:47.487492 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-37f988dd-7a8e-425b-87de-4fe7ec36b9cb tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:39:47.488184 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-37f988dd-7a8e-425b-87de-4fe7ec36b9cb tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:39:47.489094 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-37f988dd-7a8e-425b-87de-4fe7ec36b9cb tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:39:47.490336 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-37f988dd-7a8e-425b-87de-4fe7ec36b9cb tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:39:47.575977 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-37f988dd-7a8e-425b-87de-4fe7ec36b9cb tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '446b13b4661542c097afafb32443dae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3b18ee23fb548709fc513c7e1cfe623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:39:47.584514 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-37f988dd-7a8e-425b-87de-4fe7ec36b9cb tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] 10.222.0.42 "GET /compute/v2.1/servers/9063a59c-4c5f-4e65-8fd8-ffc525024f22" status: 200 len: 1217 microversion: 2.1 time: 0.110536 Jun 06 10:39:47.594522 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 104/213] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:39:47 2022] GET /compute/v2.1/servers/9063a59c-4c5f-4e65-8fd8-ffc525024f22 => generated 1217 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:39:47.600263 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-45a15378-c113-424a-846a-1226711b3adf tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:39:47.601410 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-45a15378-c113-424a-846a-1226711b3adf tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] [instance: 6345448b-01b7-4429-bb10-fc5ae449ef71] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:39:47.608207 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-45a15378-c113-424a-846a-1226711b3adf tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:39:47.608852 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-45a15378-c113-424a-846a-1226711b3adf tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:39:47.609621 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-45a15378-c113-424a-846a-1226711b3adf tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:39:47.610054 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-45a15378-c113-424a-846a-1226711b3adf tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:39:47.847776 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-45a15378-c113-424a-846a-1226711b3adf tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f269e146c844480c822347c3a38d103b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2b17b61b73b4e6d81dd8ffe9cf311ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:39:47.871287 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-45a15378-c113-424a-846a-1226711b3adf tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] 10.222.0.42 "GET /compute/v2.1/servers/6345448b-01b7-4429-bb10-fc5ae449ef71" status: 200 len: 1522 microversion: 2.1 time: 0.273737 Jun 06 10:39:47.874179 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 110/214] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:39:47 2022] GET /compute/v2.1/servers/6345448b-01b7-4429-bb10-fc5ae449ef71 => generated 1522 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:39:48.601894 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-2df4b896-6b32-4664-8584-0b425cf7f15f tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:39:48.602597 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-2df4b896-6b32-4664-8584-0b425cf7f15f tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] [instance: 9063a59c-4c5f-4e65-8fd8-ffc525024f22] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:39:48.623888 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-2df4b896-6b32-4664-8584-0b425cf7f15f tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:39:48.629548 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-2df4b896-6b32-4664-8584-0b425cf7f15f tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:39:48.630580 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-2df4b896-6b32-4664-8584-0b425cf7f15f tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:39:48.631030 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-2df4b896-6b32-4664-8584-0b425cf7f15f tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:39:48.889351 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-9689db07-a1cd-403f-b800-075669678c8b tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:39:48.890632 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-9689db07-a1cd-403f-b800-075669678c8b tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] [instance: 6345448b-01b7-4429-bb10-fc5ae449ef71] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:39:48.899028 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-9689db07-a1cd-403f-b800-075669678c8b tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:39:48.899671 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-9689db07-a1cd-403f-b800-075669678c8b tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:39:48.900929 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-9689db07-a1cd-403f-b800-075669678c8b tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:39:48.901552 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-9689db07-a1cd-403f-b800-075669678c8b tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:39:48.928182 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-2df4b896-6b32-4664-8584-0b425cf7f15f tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '446b13b4661542c097afafb32443dae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3b18ee23fb548709fc513c7e1cfe623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:39:48.936685 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-2df4b896-6b32-4664-8584-0b425cf7f15f tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] 10.222.0.42 "GET /compute/v2.1/servers/9063a59c-4c5f-4e65-8fd8-ffc525024f22" status: 200 len: 1265 microversion: 2.1 time: 0.338569 Jun 06 10:39:48.937270 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 105/215] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:39:48 2022] GET /compute/v2.1/servers/9063a59c-4c5f-4e65-8fd8-ffc525024f22 => generated 1265 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:39:49.084830 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-9689db07-a1cd-403f-b800-075669678c8b tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f269e146c844480c822347c3a38d103b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2b17b61b73b4e6d81dd8ffe9cf311ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:39:49.096833 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-9689db07-a1cd-403f-b800-075669678c8b tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] 10.222.0.42 "GET /compute/v2.1/servers/6345448b-01b7-4429-bb10-fc5ae449ef71" status: 200 len: 1522 microversion: 2.1 time: 0.211349 Jun 06 10:39:49.097582 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 111/216] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:39:48 2022] GET /compute/v2.1/servers/6345448b-01b7-4429-bb10-fc5ae449ef71 => generated 1522 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 10:39:49.954592 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-0247e147-75e0-4335-8435-07d95185665e tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:39:49.955355 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-0247e147-75e0-4335-8435-07d95185665e tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] [instance: 9063a59c-4c5f-4e65-8fd8-ffc525024f22] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:39:49.961894 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-0247e147-75e0-4335-8435-07d95185665e tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:39:49.962496 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-0247e147-75e0-4335-8435-07d95185665e tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:39:49.964235 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-0247e147-75e0-4335-8435-07d95185665e tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:39:49.964781 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-0247e147-75e0-4335-8435-07d95185665e tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:39:50.098366 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-0247e147-75e0-4335-8435-07d95185665e tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '446b13b4661542c097afafb32443dae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3b18ee23fb548709fc513c7e1cfe623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:39:50.116058 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-bcb3ca32-5fd0-4a74-bf98-47685fda7ce3 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:39:50.117675 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-bcb3ca32-5fd0-4a74-bf98-47685fda7ce3 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] [instance: 6345448b-01b7-4429-bb10-fc5ae449ef71] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:39:50.127689 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-0247e147-75e0-4335-8435-07d95185665e tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] 10.222.0.42 "GET /compute/v2.1/servers/9063a59c-4c5f-4e65-8fd8-ffc525024f22" status: 200 len: 1265 microversion: 2.1 time: 0.177482 Jun 06 10:39:50.128028 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-bcb3ca32-5fd0-4a74-bf98-47685fda7ce3 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:39:50.128492 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-bcb3ca32-5fd0-4a74-bf98-47685fda7ce3 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:39:50.138140 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-bcb3ca32-5fd0-4a74-bf98-47685fda7ce3 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:39:50.138320 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 106/217] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:39:49 2022] GET /compute/v2.1/servers/9063a59c-4c5f-4e65-8fd8-ffc525024f22 => generated 1265 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:39:50.138436 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-bcb3ca32-5fd0-4a74-bf98-47685fda7ce3 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:39:50.366393 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-bcb3ca32-5fd0-4a74-bf98-47685fda7ce3 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f269e146c844480c822347c3a38d103b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2b17b61b73b4e6d81dd8ffe9cf311ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:39:50.399463 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-bcb3ca32-5fd0-4a74-bf98-47685fda7ce3 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] 10.222.0.42 "GET /compute/v2.1/servers/6345448b-01b7-4429-bb10-fc5ae449ef71" status: 200 len: 1522 microversion: 2.1 time: 0.282663 Jun 06 10:39:50.400206 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 112/218] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:39:50 2022] GET /compute/v2.1/servers/6345448b-01b7-4429-bb10-fc5ae449ef71 => generated 1522 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:39:51.147949 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-849ee13f-7050-4add-9b99-78f2278af700 tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:39:51.149409 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-849ee13f-7050-4add-9b99-78f2278af700 tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] [instance: 9063a59c-4c5f-4e65-8fd8-ffc525024f22] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:39:51.157569 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-849ee13f-7050-4add-9b99-78f2278af700 tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:39:51.158529 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-849ee13f-7050-4add-9b99-78f2278af700 tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:39:51.159313 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-849ee13f-7050-4add-9b99-78f2278af700 tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:39:51.160349 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-849ee13f-7050-4add-9b99-78f2278af700 tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:39:51.284311 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-849ee13f-7050-4add-9b99-78f2278af700 tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '446b13b4661542c097afafb32443dae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3b18ee23fb548709fc513c7e1cfe623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:39:51.294431 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-849ee13f-7050-4add-9b99-78f2278af700 tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] 10.222.0.42 "GET /compute/v2.1/servers/9063a59c-4c5f-4e65-8fd8-ffc525024f22" status: 200 len: 1273 microversion: 2.1 time: 0.151708 Jun 06 10:39:51.295766 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 107/219] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:39:51 2022] GET /compute/v2.1/servers/9063a59c-4c5f-4e65-8fd8-ffc525024f22 => generated 1273 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:39:51.417800 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-6a2001a6-29ad-49ea-b215-4023cfd1f8ce tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:39:51.418517 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-6a2001a6-29ad-49ea-b215-4023cfd1f8ce tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] [instance: 6345448b-01b7-4429-bb10-fc5ae449ef71] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:39:51.425718 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-6a2001a6-29ad-49ea-b215-4023cfd1f8ce tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:39:51.426571 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-6a2001a6-29ad-49ea-b215-4023cfd1f8ce tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:39:51.427329 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-6a2001a6-29ad-49ea-b215-4023cfd1f8ce tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:39:51.427766 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-6a2001a6-29ad-49ea-b215-4023cfd1f8ce tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:39:51.587895 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-6a2001a6-29ad-49ea-b215-4023cfd1f8ce tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f269e146c844480c822347c3a38d103b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2b17b61b73b4e6d81dd8ffe9cf311ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:39:51.596402 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-6a2001a6-29ad-49ea-b215-4023cfd1f8ce tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] 10.222.0.42 "GET /compute/v2.1/servers/6345448b-01b7-4429-bb10-fc5ae449ef71" status: 200 len: 1522 microversion: 2.1 time: 0.183296 Jun 06 10:39:51.597062 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 113/220] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:39:51 2022] GET /compute/v2.1/servers/6345448b-01b7-4429-bb10-fc5ae449ef71 => generated 1522 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:39:52.312867 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-9085bf09-7422-4179-acc2-eda708e70471 tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:39:52.314733 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-9085bf09-7422-4179-acc2-eda708e70471 tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] [instance: 9063a59c-4c5f-4e65-8fd8-ffc525024f22] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:39:52.339204 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-9085bf09-7422-4179-acc2-eda708e70471 tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:39:52.340209 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-9085bf09-7422-4179-acc2-eda708e70471 tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:39:52.343629 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-9085bf09-7422-4179-acc2-eda708e70471 tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:39:52.345681 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-9085bf09-7422-4179-acc2-eda708e70471 tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:39:52.592799 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-9085bf09-7422-4179-acc2-eda708e70471 tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '446b13b4661542c097afafb32443dae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3b18ee23fb548709fc513c7e1cfe623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:39:52.601208 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-9085bf09-7422-4179-acc2-eda708e70471 tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] 10.222.0.42 "GET /compute/v2.1/servers/9063a59c-4c5f-4e65-8fd8-ffc525024f22" status: 200 len: 1283 microversion: 2.1 time: 0.292916 Jun 06 10:39:52.601892 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 108/221] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:39:52 2022] GET /compute/v2.1/servers/9063a59c-4c5f-4e65-8fd8-ffc525024f22 => generated 1283 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:39:52.624364 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-cf0c950d-bc8c-4e19-91c3-7308936bfcce tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:39:52.624999 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-cf0c950d-bc8c-4e19-91c3-7308936bfcce tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] [instance: 6345448b-01b7-4429-bb10-fc5ae449ef71] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:39:52.639162 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-cf0c950d-bc8c-4e19-91c3-7308936bfcce tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:39:52.639833 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-cf0c950d-bc8c-4e19-91c3-7308936bfcce tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:39:52.642664 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-cf0c950d-bc8c-4e19-91c3-7308936bfcce tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:39:52.643391 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-cf0c950d-bc8c-4e19-91c3-7308936bfcce tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:39:53.159889 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-cf0c950d-bc8c-4e19-91c3-7308936bfcce tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f269e146c844480c822347c3a38d103b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2b17b61b73b4e6d81dd8ffe9cf311ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:39:53.172188 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-cf0c950d-bc8c-4e19-91c3-7308936bfcce tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] 10.222.0.42 "GET /compute/v2.1/servers/6345448b-01b7-4429-bb10-fc5ae449ef71" status: 200 len: 1522 microversion: 2.1 time: 0.556057 Jun 06 10:39:53.173016 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 114/222] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:39:52 2022] GET /compute/v2.1/servers/6345448b-01b7-4429-bb10-fc5ae449ef71 => generated 1522 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:39:53.626292 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-3edd7951-edb7-4772-9450-519ce79a8c0c tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:39:53.627385 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-3edd7951-edb7-4772-9450-519ce79a8c0c tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] [instance: 9063a59c-4c5f-4e65-8fd8-ffc525024f22] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:39:53.639771 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-3edd7951-edb7-4772-9450-519ce79a8c0c tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:39:53.644102 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-3edd7951-edb7-4772-9450-519ce79a8c0c tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:39:53.647460 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-3edd7951-edb7-4772-9450-519ce79a8c0c tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:39:53.648920 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-3edd7951-edb7-4772-9450-519ce79a8c0c tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:39:53.900150 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-3edd7951-edb7-4772-9450-519ce79a8c0c tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '446b13b4661542c097afafb32443dae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3b18ee23fb548709fc513c7e1cfe623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:39:53.911769 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-3edd7951-edb7-4772-9450-519ce79a8c0c tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] 10.222.0.42 "GET /compute/v2.1/servers/9063a59c-4c5f-4e65-8fd8-ffc525024f22" status: 200 len: 1313 microversion: 2.1 time: 0.294477 Jun 06 10:39:53.912665 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 109/223] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:39:53 2022] GET /compute/v2.1/servers/9063a59c-4c5f-4e65-8fd8-ffc525024f22 => generated 1313 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:39:54.189633 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-8efeff30-d3b5-4cd4-aaca-ff21ab81568f tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:39:54.190243 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-8efeff30-d3b5-4cd4-aaca-ff21ab81568f tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] [instance: 6345448b-01b7-4429-bb10-fc5ae449ef71] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:39:54.197511 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-8efeff30-d3b5-4cd4-aaca-ff21ab81568f tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:39:54.198258 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-8efeff30-d3b5-4cd4-aaca-ff21ab81568f tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:39:54.199278 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-8efeff30-d3b5-4cd4-aaca-ff21ab81568f tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:39:54.199950 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-8efeff30-d3b5-4cd4-aaca-ff21ab81568f tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:39:54.409540 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-8efeff30-d3b5-4cd4-aaca-ff21ab81568f tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f269e146c844480c822347c3a38d103b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2b17b61b73b4e6d81dd8ffe9cf311ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:39:54.419647 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-8efeff30-d3b5-4cd4-aaca-ff21ab81568f tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] 10.222.0.42 "GET /compute/v2.1/servers/6345448b-01b7-4429-bb10-fc5ae449ef71" status: 200 len: 1522 microversion: 2.1 time: 0.233755 Jun 06 10:39:54.421221 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 115/224] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:39:54 2022] GET /compute/v2.1/servers/6345448b-01b7-4429-bb10-fc5ae449ef71 => generated 1522 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:39:54.932720 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-d81435af-5c54-4b21-87fd-ed9874ff8a02 tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:39:54.945074 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-d81435af-5c54-4b21-87fd-ed9874ff8a02 tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] [instance: 9063a59c-4c5f-4e65-8fd8-ffc525024f22] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:39:54.951217 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-d81435af-5c54-4b21-87fd-ed9874ff8a02 tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:39:54.951676 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-d81435af-5c54-4b21-87fd-ed9874ff8a02 tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:39:54.954135 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-d81435af-5c54-4b21-87fd-ed9874ff8a02 tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:39:54.955621 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-d81435af-5c54-4b21-87fd-ed9874ff8a02 tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:39:55.304450 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-d81435af-5c54-4b21-87fd-ed9874ff8a02 tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '446b13b4661542c097afafb32443dae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3b18ee23fb548709fc513c7e1cfe623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:39:55.324757 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-d81435af-5c54-4b21-87fd-ed9874ff8a02 tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] 10.222.0.42 "GET /compute/v2.1/servers/9063a59c-4c5f-4e65-8fd8-ffc525024f22" status: 200 len: 1313 microversion: 2.1 time: 0.398265 Jun 06 10:39:55.325356 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 110/225] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:39:54 2022] GET /compute/v2.1/servers/9063a59c-4c5f-4e65-8fd8-ffc525024f22 => generated 1313 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:39:55.439718 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-d92003e7-6300-495d-8871-5431add2a0f1 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:39:55.440802 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-d92003e7-6300-495d-8871-5431add2a0f1 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] [instance: 6345448b-01b7-4429-bb10-fc5ae449ef71] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:39:55.450264 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-d92003e7-6300-495d-8871-5431add2a0f1 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:39:55.450970 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-d92003e7-6300-495d-8871-5431add2a0f1 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:39:55.452175 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-d92003e7-6300-495d-8871-5431add2a0f1 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:39:55.452935 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-d92003e7-6300-495d-8871-5431add2a0f1 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:39:55.770003 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-d92003e7-6300-495d-8871-5431add2a0f1 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f269e146c844480c822347c3a38d103b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2b17b61b73b4e6d81dd8ffe9cf311ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:39:55.780427 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-d92003e7-6300-495d-8871-5431add2a0f1 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] 10.222.0.42 "GET /compute/v2.1/servers/6345448b-01b7-4429-bb10-fc5ae449ef71" status: 200 len: 1522 microversion: 2.1 time: 0.345544 Jun 06 10:39:55.781013 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 116/226] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:39:55 2022] GET /compute/v2.1/servers/6345448b-01b7-4429-bb10-fc5ae449ef71 => generated 1522 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:39:56.349316 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-46ca7b64-40bf-492c-800e-f717e78589d0 tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:39:56.350745 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-46ca7b64-40bf-492c-800e-f717e78589d0 tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] [instance: 9063a59c-4c5f-4e65-8fd8-ffc525024f22] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:39:56.363606 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-46ca7b64-40bf-492c-800e-f717e78589d0 tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:39:56.369065 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-46ca7b64-40bf-492c-800e-f717e78589d0 tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:39:56.372441 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-46ca7b64-40bf-492c-800e-f717e78589d0 tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:39:56.375220 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-46ca7b64-40bf-492c-800e-f717e78589d0 tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:39:56.463717 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG dbcounter [-] [129350] Writing DB stats nova_cell0:SELECT=2 {{(pid=129350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 10:39:56.797772 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-5fcdced1-5518-4b5b-8220-9a07b3a6580e tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:39:56.798376 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-5fcdced1-5518-4b5b-8220-9a07b3a6580e tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] [instance: 6345448b-01b7-4429-bb10-fc5ae449ef71] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:39:56.800380 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG dbcounter [-] [129349] Writing DB stats nova_cell0:SELECT=2 {{(pid=129349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 10:39:56.801056 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG dbcounter [-] [129349] Writing DB stats nova_cell0:SELECT=6 {{(pid=129349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 10:39:56.825249 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-5fcdced1-5518-4b5b-8220-9a07b3a6580e tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:39:56.825699 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-5fcdced1-5518-4b5b-8220-9a07b3a6580e tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:39:56.834714 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-5fcdced1-5518-4b5b-8220-9a07b3a6580e tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:39:56.835167 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-5fcdced1-5518-4b5b-8220-9a07b3a6580e tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:39:56.981921 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-46ca7b64-40bf-492c-800e-f717e78589d0 tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '446b13b4661542c097afafb32443dae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3b18ee23fb548709fc513c7e1cfe623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:39:56.985199 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG dbcounter [-] [129350] Writing DB stats nova_cell1:SELECT=100 {{(pid=129350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 10:39:57.005847 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-46ca7b64-40bf-492c-800e-f717e78589d0 tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] 10.222.0.42 "GET /compute/v2.1/servers/9063a59c-4c5f-4e65-8fd8-ffc525024f22" status: 200 len: 1313 microversion: 2.1 time: 0.664455 Jun 06 10:39:57.011253 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 111/227] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:39:56 2022] GET /compute/v2.1/servers/9063a59c-4c5f-4e65-8fd8-ffc525024f22 => generated 1313 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:39:57.363633 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-5fcdced1-5518-4b5b-8220-9a07b3a6580e tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f269e146c844480c822347c3a38d103b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2b17b61b73b4e6d81dd8ffe9cf311ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:39:57.381899 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-5fcdced1-5518-4b5b-8220-9a07b3a6580e tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] 10.222.0.42 "GET /compute/v2.1/servers/6345448b-01b7-4429-bb10-fc5ae449ef71" status: 200 len: 1522 microversion: 2.1 time: 0.585632 Jun 06 10:39:57.392154 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 117/228] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:39:56 2022] GET /compute/v2.1/servers/6345448b-01b7-4429-bb10-fc5ae449ef71 => generated 1522 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:39:58.028327 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-ce1daaa1-9290-482d-bb88-61a8176bf70a tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:39:58.028944 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-ce1daaa1-9290-482d-bb88-61a8176bf70a tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] [instance: 9063a59c-4c5f-4e65-8fd8-ffc525024f22] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:39:58.041451 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-ce1daaa1-9290-482d-bb88-61a8176bf70a tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:39:58.046753 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-ce1daaa1-9290-482d-bb88-61a8176bf70a tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:39:58.049959 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-ce1daaa1-9290-482d-bb88-61a8176bf70a tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:39:58.051254 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-ce1daaa1-9290-482d-bb88-61a8176bf70a tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:39:58.400729 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-16345b5a-6887-4120-ba2b-4cb429f1c8f0 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:39:58.401402 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-16345b5a-6887-4120-ba2b-4cb429f1c8f0 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] [instance: 6345448b-01b7-4429-bb10-fc5ae449ef71] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:39:58.412719 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-16345b5a-6887-4120-ba2b-4cb429f1c8f0 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:39:58.418513 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-16345b5a-6887-4120-ba2b-4cb429f1c8f0 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:39:58.419625 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-16345b5a-6887-4120-ba2b-4cb429f1c8f0 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:39:58.420869 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-16345b5a-6887-4120-ba2b-4cb429f1c8f0 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:39:58.487498 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-ce1daaa1-9290-482d-bb88-61a8176bf70a tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '446b13b4661542c097afafb32443dae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3b18ee23fb548709fc513c7e1cfe623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:39:58.503991 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-ce1daaa1-9290-482d-bb88-61a8176bf70a tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] 10.222.0.42 "GET /compute/v2.1/servers/9063a59c-4c5f-4e65-8fd8-ffc525024f22" status: 200 len: 1313 microversion: 2.1 time: 0.480413 Jun 06 10:39:58.515601 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 112/229] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:39:58 2022] GET /compute/v2.1/servers/9063a59c-4c5f-4e65-8fd8-ffc525024f22 => generated 1313 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:39:58.745241 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-16345b5a-6887-4120-ba2b-4cb429f1c8f0 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f269e146c844480c822347c3a38d103b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2b17b61b73b4e6d81dd8ffe9cf311ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:39:58.760594 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-16345b5a-6887-4120-ba2b-4cb429f1c8f0 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] 10.222.0.42 "GET /compute/v2.1/servers/6345448b-01b7-4429-bb10-fc5ae449ef71" status: 200 len: 1502 microversion: 2.1 time: 0.365350 Jun 06 10:39:58.761333 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 118/230] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:39:58 2022] GET /compute/v2.1/servers/6345448b-01b7-4429-bb10-fc5ae449ef71 => generated 1502 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 10:39:58.782248 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-be7efcd0-cb20-4f96-a2b9-4063ed16882e tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e42ce651-af51-4042-98b9-9a0b4d103b6d"}} {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 10:39:58.783448 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-be7efcd0-cb20-4f96-a2b9-4063ed16882e tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] [instance: 6345448b-01b7-4429-bb10-fc5ae449ef71] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:39:58.815714 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-be7efcd0-cb20-4f96-a2b9-4063ed16882e tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:39:58.816462 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-be7efcd0-cb20-4f96-a2b9-4063ed16882e tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:39:58.817541 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-be7efcd0-cb20-4f96-a2b9-4063ed16882e tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:39:58.818256 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-be7efcd0-cb20-4f96-a2b9-4063ed16882e tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:39:58.867326 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.wsgi [None req-be7efcd0-cb20-4f96-a2b9-4063ed16882e tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] HTTP exception thrown: Cannot 'attach_volume' instance 6345448b-01b7-4429-bb10-fc5ae449ef71 while it is in vm_state rescued Jun 06 10:39:58.872833 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-be7efcd0-cb20-4f96-a2b9-4063ed16882e tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Request method failure captured: Jun 06 10:39:58.872833 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: request: POST /compute/v2.1/servers/6345448b-01b7-4429-bb10-fc5ae449ef71/os-volume_attachments HTTP/1.1 Jun 06 10:39:58.872833 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: Accept: application/json Jun 06 10:39:58.872833 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: Accept-Encoding: identity Jun 06 10:39:58.872833 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: Connection: close Jun 06 10:39:58.872833 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: Content-Length: 74 Jun 06 10:39:58.872833 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: Content-Type: application/json Jun 06 10:39:58.872833 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: Host: 10.222.0.42 Jun 06 10:39:58.872833 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: Openstack-System-Scope: None Jun 06 10:39:58.872833 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: User-Agent: python-urllib3/1.26.9 Jun 06 10:39:58.872833 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Auth-Token: gAAAAABindkdTi5hfwDU83R9VhMkvWDNoCDXiLpe7k4NfzgQuE9NKNHlwwxS39qNqJOxZC6I04U-PKIxWUtLJRI9QDIkTy_6J-jWfq_sDX7gjSO5-TBVY66fu2QztBfvxrVdG6V04r923VMuTI7eBl9-Tc1Ek2lWzslMW2bMYBl_aa_BZDF8fUA Jun 06 10:39:58.872833 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Domain-Id: None Jun 06 10:39:58.872833 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Domain-Name: None Jun 06 10:39:58.872833 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Identity-Status: Confirmed Jun 06 10:39:58.872833 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Is-Admin-Project: True Jun 06 10:39:58.872833 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Project-Domain-Id: default Jun 06 10:39:58.872833 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Project-Domain-Name: Default Jun 06 10:39:58.872833 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Project-Id: e2b17b61b73b4e6d81dd8ffe9cf311ea Jun 06 10:39:58.872833 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-845602198 Jun 06 10:39:58.872833 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Role: member,reader Jun 06 10:39:58.872833 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Roles: member,reader Jun 06 10:39:58.874084 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/e2b17b61b73b4e6d81dd8ffe9cf311ea"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e2b17b61b73b4e6d81dd8ffe9cf311ea"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e2b17b61b73b4e6d81dd8ffe9cf311ea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_e2b17b61b73b4e6d81dd8ffe9cf311ea", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Jun 06 10:39:58.874084 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Tenant: tempest-ServerRescueNegativeTestJSON-845602198 Jun 06 10:39:58.874084 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Tenant-Id: e2b17b61b73b4e6d81dd8ffe9cf311ea Jun 06 10:39:58.874084 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-845602198 Jun 06 10:39:58.874084 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-User: tempest-ServerRescueNegativeTestJSON-845602198-project Jun 06 10:39:58.874084 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-User-Domain-Id: default Jun 06 10:39:58.874084 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-User-Domain-Name: Default Jun 06 10:39:58.874084 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-User-Id: f269e146c844480c822347c3a38d103b Jun 06 10:39:58.874084 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-User-Name: tempest-ServerRescueNegativeTestJSON-845602198-project Jun 06 10:39:58.874084 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: Jun 06 10:39:58.874084 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: {"volumeAttachment": {"volumeId": "e42ce651-af51-4042-98b9-9a0b4d103b6d"}} Jun 06 10:39:58.874084 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: method: > Jun 06 10:39:58.874882 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: exception: Cannot 'attach_volume' instance 6345448b-01b7-4429-bb10-fc5ae449ef71 while it is in vm_state rescued Jun 06 10:39:58.874882 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: action_args: {'server_id': '6345448b-01b7-4429-bb10-fc5ae449ef71', 'body': {'volumeAttachment': {'volumeId': 'e42ce651-af51-4042-98b9-9a0b4d103b6d'}}} Jun 06 10:39:58.874882 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 10:39:58.874882 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 10:39:58.874882 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 06 10:39:58.874882 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 06 10:39:58.874882 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 06 10:39:58.874882 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 06 10:39:58.874882 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 06 10:39:58.874882 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 06 10:39:58.874882 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 6345448b-01b7-4429-bb10-fc5ae449ef71 in vm_state rescued. Cannot attach_volume while the instance is in this state. Jun 06 10:39:58.874882 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Jun 06 10:39:58.874882 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 10:39:58.874882 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Jun 06 10:39:58.874882 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 10:39:58.874882 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 10:39:58.874882 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 10:39:58.874882 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 10:39:58.874882 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 10:39:58.880140 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 10:39:58.880140 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 10:39:58.880140 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 06 10:39:58.880140 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 06 10:39:58.880140 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 06 10:39:58.880140 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 06 10:39:58.880140 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 06 10:39:58.880140 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 06 10:39:58.880140 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jun 06 10:39:58.880140 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 06 10:39:58.880140 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 06 10:39:58.880140 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 06 10:39:58.880140 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 6345448b-01b7-4429-bb10-fc5ae449ef71 while it is in vm_state rescued Jun 06 10:39:58.880140 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Jun 06 10:39:58.880140 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 10:39:58.880140 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Jun 06 10:39:58.880140 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 10:39:58.880140 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 10:39:58.880140 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 10:39:58.881608 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 10:39:58.881608 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 10:39:58.881608 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 6345448b-01b7-4429-bb10-fc5ae449ef71 while it is in vm_state rescued Jun 06 10:39:58.881608 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Jun 06 10:39:58.881608 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-be7efcd0-cb20-4f96-a2b9-4063ed16882e tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Returning 409 to user: Cannot 'attach_volume' instance 6345448b-01b7-4429-bb10-fc5ae449ef71 while it is in vm_state rescued {{(pid=129349) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 10:39:58.881608 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-be7efcd0-cb20-4f96-a2b9-4063ed16882e tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] 10.222.0.42 "POST /compute/v2.1/servers/6345448b-01b7-4429-bb10-fc5ae449ef71/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.097829 Jun 06 10:39:58.881608 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 119/231] 10.222.0.42 () {60 vars in 1322 bytes} [Mon Jun 6 10:39:58 2022] POST /compute/v2.1/servers/6345448b-01b7-4429-bb10-fc5ae449ef71/os-volume_attachments => generated 152 bytes in 99 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 06 10:39:58.889876 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [req-e4f0347b-0433-4f18-9877-0b4ef7ca9936 req-27b36cc7-d947-4da3-8479-2b3aa17078ff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9063a59c-4c5f-4e65-8fd8-ffc525024f22", "tag": "929f39cf-874c-469e-91d2-dd33bf7e85c5"}]} {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 10:39:58.926604 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [req-e4f0347b-0433-4f18-9877-0b4ef7ca9936 req-27b36cc7-d947-4da3-8479-2b3aa17078ff service nova] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:39:58.927173 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [req-e4f0347b-0433-4f18-9877-0b4ef7ca9936 req-27b36cc7-d947-4da3-8479-2b3aa17078ff service nova] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:39:58.955694 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.compute.server_external_events [req-e4f0347b-0433-4f18-9877-0b4ef7ca9936 req-27b36cc7-d947-4da3-8479-2b3aa17078ff service nova] Creating event network-changed:929f39cf-874c-469e-91d2-dd33bf7e85c5 for instance 9063a59c-4c5f-4e65-8fd8-ffc525024f22 on hv-cinder-84482 Jun 06 10:39:58.966605 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [req-e4f0347b-0433-4f18-9877-0b4ef7ca9936 req-27b36cc7-d947-4da3-8479-2b3aa17078ff service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088750 Jun 06 10:39:58.970616 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 120/232] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Jun 6 10:39:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 10:39:58.984340 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-cc580e3c-0157-48db-93c0-75ca260576b5 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 10:39:58.985139 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-cc580e3c-0157-48db-93c0-75ca260576b5 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] [instance: 6345448b-01b7-4429-bb10-fc5ae449ef71] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:39:58.994353 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-cc580e3c-0157-48db-93c0-75ca260576b5 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:39:58.994808 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-cc580e3c-0157-48db-93c0-75ca260576b5 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:39:58.995574 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-cc580e3c-0157-48db-93c0-75ca260576b5 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:39:58.996161 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-cc580e3c-0157-48db-93c0-75ca260576b5 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:39:59.016267 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG dbcounter [-] [129349] Writing DB stats nova_cell1:SELECT=100 {{(pid=129349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 10:39:59.062210 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-90c8b33b-e24f-445b-8115-8e98a6eaa36c tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Action: 'create', calling method: .version_select at 0x7f8fd84be280>, body: {"keypair": {"name": "tempest-TestShelveInstance-1759320847", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGezmCtzlzKEhY1vPkAuGU7iy3dpRaeiY1OHxdMxvxjA264qFFhrZ6AFdkoUpXKcjcQ204xFO/3+HryJudckdVwHiFU1+y3/lkHvI8OmuCDzPiBtqml1Yqec/PGESXO+EA=="}} {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 10:39:59.081700 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.quota [None req-90c8b33b-e24f-445b-8115-8e98a6eaa36c tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Getting quotas for project ef2496096b374f399606bff9a08b65eb. Resources: {'key_pairs'} {{(pid=129350) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 06 10:39:59.086913 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.quota [None req-90c8b33b-e24f-445b-8115-8e98a6eaa36c tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Getting quotas for user 6d09fe912b4c4cab81b00df801f69680 and project ef2496096b374f399606bff9a08b65eb. Resources: {'key_pairs'} {{(pid=129350) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 06 10:39:59.110069 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-cc580e3c-0157-48db-93c0-75ca260576b5 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] 10.222.0.42 "POST /compute/v2.1/servers/6345448b-01b7-4429-bb10-fc5ae449ef71/action" status: 202 len: 0 microversion: 2.1 time: 0.137156 Jun 06 10:39:59.113018 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 121/233] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Jun 6 10:39:58 2022] POST /compute/v2.1/servers/6345448b-01b7-4429-bb10-fc5ae449ef71/action => generated 0 bytes in 142 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 06 10:39:59.122811 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-23119ccf-9879-4b50-83ee-5a62f4afeca0 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:39:59.125183 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-23119ccf-9879-4b50-83ee-5a62f4afeca0 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] [instance: 6345448b-01b7-4429-bb10-fc5ae449ef71] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:39:59.140613 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-90c8b33b-e24f-445b-8115-8e98a6eaa36c tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.461254 Jun 06 10:39:59.142698 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 113/234] 10.222.0.42 () {60 vars in 1158 bytes} [Mon Jun 6 10:39:58 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 10:39:59.164113 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-23119ccf-9879-4b50-83ee-5a62f4afeca0 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:39:59.166363 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-23119ccf-9879-4b50-83ee-5a62f4afeca0 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:39:59.167470 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-23119ccf-9879-4b50-83ee-5a62f4afeca0 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:39:59.167952 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-23119ccf-9879-4b50-83ee-5a62f4afeca0 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:39:59.532860 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-1d8dfc5b-fb9c-4136-b5f6-deac8862fa72 tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:39:59.535393 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-1d8dfc5b-fb9c-4136-b5f6-deac8862fa72 tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] [instance: 9063a59c-4c5f-4e65-8fd8-ffc525024f22] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:39:59.551091 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-1d8dfc5b-fb9c-4136-b5f6-deac8862fa72 tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:39:59.553614 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-1d8dfc5b-fb9c-4136-b5f6-deac8862fa72 tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:39:59.554462 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-1d8dfc5b-fb9c-4136-b5f6-deac8862fa72 tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:39:59.554900 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-1d8dfc5b-fb9c-4136-b5f6-deac8862fa72 tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:39:59.781020 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-23119ccf-9879-4b50-83ee-5a62f4afeca0 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f269e146c844480c822347c3a38d103b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2b17b61b73b4e6d81dd8ffe9cf311ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:39:59.792047 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-23119ccf-9879-4b50-83ee-5a62f4afeca0 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] 10.222.0.42 "GET /compute/v2.1/servers/6345448b-01b7-4429-bb10-fc5ae449ef71" status: 200 len: 1510 microversion: 2.1 time: 0.674381 Jun 06 10:39:59.792628 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 122/235] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:39:59 2022] GET /compute/v2.1/servers/6345448b-01b7-4429-bb10-fc5ae449ef71 => generated 1510 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:39:59.885482 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-1d8dfc5b-fb9c-4136-b5f6-deac8862fa72 tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '446b13b4661542c097afafb32443dae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3b18ee23fb548709fc513c7e1cfe623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:39:59.894629 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-1d8dfc5b-fb9c-4136-b5f6-deac8862fa72 tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] 10.222.0.42 "GET /compute/v2.1/servers/9063a59c-4c5f-4e65-8fd8-ffc525024f22" status: 200 len: 1313 microversion: 2.1 time: 0.373932 Jun 06 10:39:59.895196 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 114/236] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:39:59 2022] GET /compute/v2.1/servers/9063a59c-4c5f-4e65-8fd8-ffc525024f22 => generated 1313 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:40:00.812303 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-718aa0ad-d512-4477-b7c3-6d739e96e23f tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:40:00.814255 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-718aa0ad-d512-4477-b7c3-6d739e96e23f tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] [instance: 6345448b-01b7-4429-bb10-fc5ae449ef71] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:40:00.826747 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-718aa0ad-d512-4477-b7c3-6d739e96e23f tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:40:00.827232 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-718aa0ad-d512-4477-b7c3-6d739e96e23f tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:40:00.828039 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-718aa0ad-d512-4477-b7c3-6d739e96e23f tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:40:00.828483 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-718aa0ad-d512-4477-b7c3-6d739e96e23f tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:40:00.913190 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-8fad5799-411e-4aa4-8918-d689b9547be4 tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:40:00.914480 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-8fad5799-411e-4aa4-8918-d689b9547be4 tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] [instance: 9063a59c-4c5f-4e65-8fd8-ffc525024f22] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:40:00.922960 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-8fad5799-411e-4aa4-8918-d689b9547be4 tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:40:00.923666 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-8fad5799-411e-4aa4-8918-d689b9547be4 tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:40:00.924964 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-8fad5799-411e-4aa4-8918-d689b9547be4 tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:40:00.925492 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-8fad5799-411e-4aa4-8918-d689b9547be4 tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:40:01.008121 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-718aa0ad-d512-4477-b7c3-6d739e96e23f tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f269e146c844480c822347c3a38d103b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2b17b61b73b4e6d81dd8ffe9cf311ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:40:01.014038 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-718aa0ad-d512-4477-b7c3-6d739e96e23f tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] 10.222.0.42 "GET /compute/v2.1/servers/6345448b-01b7-4429-bb10-fc5ae449ef71" status: 200 len: 1510 microversion: 2.1 time: 0.208092 Jun 06 10:40:01.014615 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 123/237] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:40:00 2022] GET /compute/v2.1/servers/6345448b-01b7-4429-bb10-fc5ae449ef71 => generated 1510 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:40:01.122543 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-8fad5799-411e-4aa4-8918-d689b9547be4 tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '446b13b4661542c097afafb32443dae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3b18ee23fb548709fc513c7e1cfe623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:40:01.131080 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-8fad5799-411e-4aa4-8918-d689b9547be4 tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] 10.222.0.42 "GET /compute/v2.1/servers/9063a59c-4c5f-4e65-8fd8-ffc525024f22" status: 200 len: 1313 microversion: 2.1 time: 0.222024 Jun 06 10:40:01.134994 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 115/238] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:40:00 2022] GET /compute/v2.1/servers/9063a59c-4c5f-4e65-8fd8-ffc525024f22 => generated 1313 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 10:40:02.030620 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-5c9b67ad-a57a-4d32-b571-c0883ac7cc55 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:40:02.031229 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-5c9b67ad-a57a-4d32-b571-c0883ac7cc55 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] [instance: 6345448b-01b7-4429-bb10-fc5ae449ef71] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:40:02.038043 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-5c9b67ad-a57a-4d32-b571-c0883ac7cc55 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:40:02.038892 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-5c9b67ad-a57a-4d32-b571-c0883ac7cc55 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:40:02.039723 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-5c9b67ad-a57a-4d32-b571-c0883ac7cc55 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:40:02.040180 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-5c9b67ad-a57a-4d32-b571-c0883ac7cc55 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:40:02.149139 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-bca05fc0-9c15-4bc7-87fb-414c21242390 tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:40:02.150563 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-bca05fc0-9c15-4bc7-87fb-414c21242390 tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] [instance: 9063a59c-4c5f-4e65-8fd8-ffc525024f22] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:40:02.156772 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-bca05fc0-9c15-4bc7-87fb-414c21242390 tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:40:02.157486 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-bca05fc0-9c15-4bc7-87fb-414c21242390 tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:40:02.158649 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-bca05fc0-9c15-4bc7-87fb-414c21242390 tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:40:02.158868 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-bca05fc0-9c15-4bc7-87fb-414c21242390 tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:40:02.179808 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-5c9b67ad-a57a-4d32-b571-c0883ac7cc55 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f269e146c844480c822347c3a38d103b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2b17b61b73b4e6d81dd8ffe9cf311ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:40:02.188163 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-5c9b67ad-a57a-4d32-b571-c0883ac7cc55 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] 10.222.0.42 "GET /compute/v2.1/servers/6345448b-01b7-4429-bb10-fc5ae449ef71" status: 200 len: 1510 microversion: 2.1 time: 0.161276 Jun 06 10:40:02.188734 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 124/239] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:40:02 2022] GET /compute/v2.1/servers/6345448b-01b7-4429-bb10-fc5ae449ef71 => generated 1510 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:40:02.301470 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-bca05fc0-9c15-4bc7-87fb-414c21242390 tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '446b13b4661542c097afafb32443dae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3b18ee23fb548709fc513c7e1cfe623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:40:02.309350 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-bca05fc0-9c15-4bc7-87fb-414c21242390 tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] 10.222.0.42 "GET /compute/v2.1/servers/9063a59c-4c5f-4e65-8fd8-ffc525024f22" status: 200 len: 1313 microversion: 2.1 time: 0.164006 Jun 06 10:40:02.310075 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 116/240] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:40:02 2022] GET /compute/v2.1/servers/9063a59c-4c5f-4e65-8fd8-ffc525024f22 => generated 1313 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 10:40:03.205705 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-78dda276-59de-47d0-b3ff-13cccd430ba1 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:40:03.206432 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-78dda276-59de-47d0-b3ff-13cccd430ba1 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] [instance: 6345448b-01b7-4429-bb10-fc5ae449ef71] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:40:03.209173 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG dbcounter [-] [129349] Writing DB stats nova_api:SELECT=72,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=129349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 10:40:03.215884 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-78dda276-59de-47d0-b3ff-13cccd430ba1 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:40:03.216326 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-78dda276-59de-47d0-b3ff-13cccd430ba1 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:40:03.217091 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-78dda276-59de-47d0-b3ff-13cccd430ba1 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:40:03.217518 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-78dda276-59de-47d0-b3ff-13cccd430ba1 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:40:03.326499 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-9995fc89-8b1d-4228-a2ee-e565ca91c944 tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:40:03.327112 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-9995fc89-8b1d-4228-a2ee-e565ca91c944 tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] [instance: 9063a59c-4c5f-4e65-8fd8-ffc525024f22] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:40:03.336383 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-9995fc89-8b1d-4228-a2ee-e565ca91c944 tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:40:03.336910 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-9995fc89-8b1d-4228-a2ee-e565ca91c944 tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:40:03.338401 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-9995fc89-8b1d-4228-a2ee-e565ca91c944 tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:40:03.339005 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-9995fc89-8b1d-4228-a2ee-e565ca91c944 tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:40:03.357389 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-78dda276-59de-47d0-b3ff-13cccd430ba1 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f269e146c844480c822347c3a38d103b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2b17b61b73b4e6d81dd8ffe9cf311ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:40:03.367036 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-78dda276-59de-47d0-b3ff-13cccd430ba1 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] 10.222.0.42 "GET /compute/v2.1/servers/6345448b-01b7-4429-bb10-fc5ae449ef71" status: 200 len: 1510 microversion: 2.1 time: 0.165220 Jun 06 10:40:03.368135 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 125/241] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:40:03 2022] GET /compute/v2.1/servers/6345448b-01b7-4429-bb10-fc5ae449ef71 => generated 1510 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:40:03.484651 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-9995fc89-8b1d-4228-a2ee-e565ca91c944 tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '446b13b4661542c097afafb32443dae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3b18ee23fb548709fc513c7e1cfe623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:40:03.492779 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-9995fc89-8b1d-4228-a2ee-e565ca91c944 tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] 10.222.0.42 "GET /compute/v2.1/servers/9063a59c-4c5f-4e65-8fd8-ffc525024f22" status: 200 len: 1313 microversion: 2.1 time: 0.170806 Jun 06 10:40:03.493745 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 117/242] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:40:03 2022] GET /compute/v2.1/servers/9063a59c-4c5f-4e65-8fd8-ffc525024f22 => generated 1313 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:40:04.388988 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-b0b04321-2313-4037-9e09-6829e90e501d tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:40:04.390397 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-b0b04321-2313-4037-9e09-6829e90e501d tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] [instance: 6345448b-01b7-4429-bb10-fc5ae449ef71] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:40:04.402706 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-b0b04321-2313-4037-9e09-6829e90e501d tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:40:04.403489 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-b0b04321-2313-4037-9e09-6829e90e501d tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:40:04.405919 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-b0b04321-2313-4037-9e09-6829e90e501d tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:40:04.409571 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-b0b04321-2313-4037-9e09-6829e90e501d tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:40:04.511557 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-c9d1805a-47a9-469a-9c89-49438714bdd8 tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:40:04.512796 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-c9d1805a-47a9-469a-9c89-49438714bdd8 tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] [instance: 9063a59c-4c5f-4e65-8fd8-ffc525024f22] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:40:04.514995 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG dbcounter [-] [129350] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=1 {{(pid=129350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 10:40:04.521641 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-c9d1805a-47a9-469a-9c89-49438714bdd8 tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:40:04.522260 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-c9d1805a-47a9-469a-9c89-49438714bdd8 tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:40:04.523201 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-c9d1805a-47a9-469a-9c89-49438714bdd8 tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:40:04.523656 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-c9d1805a-47a9-469a-9c89-49438714bdd8 tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:40:04.629913 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-b0b04321-2313-4037-9e09-6829e90e501d tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f269e146c844480c822347c3a38d103b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2b17b61b73b4e6d81dd8ffe9cf311ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:40:04.639769 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-b0b04321-2313-4037-9e09-6829e90e501d tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] 10.222.0.42 "GET /compute/v2.1/servers/6345448b-01b7-4429-bb10-fc5ae449ef71" status: 200 len: 1510 microversion: 2.1 time: 0.257704 Jun 06 10:40:04.650457 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 126/243] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:40:04 2022] GET /compute/v2.1/servers/6345448b-01b7-4429-bb10-fc5ae449ef71 => generated 1510 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:40:04.715322 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-c9d1805a-47a9-469a-9c89-49438714bdd8 tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '446b13b4661542c097afafb32443dae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3b18ee23fb548709fc513c7e1cfe623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:40:04.722731 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-c9d1805a-47a9-469a-9c89-49438714bdd8 tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] 10.222.0.42 "GET /compute/v2.1/servers/9063a59c-4c5f-4e65-8fd8-ffc525024f22" status: 200 len: 1313 microversion: 2.1 time: 0.216784 Jun 06 10:40:04.723319 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 118/244] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:40:04 2022] GET /compute/v2.1/servers/9063a59c-4c5f-4e65-8fd8-ffc525024f22 => generated 1313 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 10:40:05.659258 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-7007174c-4177-45be-a8cb-588008fabfe4 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:40:05.659830 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-7007174c-4177-45be-a8cb-588008fabfe4 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] [instance: 6345448b-01b7-4429-bb10-fc5ae449ef71] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:40:05.667862 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-7007174c-4177-45be-a8cb-588008fabfe4 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:40:05.669465 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-7007174c-4177-45be-a8cb-588008fabfe4 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:40:05.670921 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-7007174c-4177-45be-a8cb-588008fabfe4 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:40:05.672231 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-7007174c-4177-45be-a8cb-588008fabfe4 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:40:05.743162 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-3d47ee25-7f4d-4c79-905e-eaf1c6fdb37f tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:40:05.743952 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-3d47ee25-7f4d-4c79-905e-eaf1c6fdb37f tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] [instance: 9063a59c-4c5f-4e65-8fd8-ffc525024f22] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:40:05.750958 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-3d47ee25-7f4d-4c79-905e-eaf1c6fdb37f tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:40:05.751631 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-3d47ee25-7f4d-4c79-905e-eaf1c6fdb37f tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:40:05.752781 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-3d47ee25-7f4d-4c79-905e-eaf1c6fdb37f tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:40:05.753365 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-3d47ee25-7f4d-4c79-905e-eaf1c6fdb37f tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:40:05.882121 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-7007174c-4177-45be-a8cb-588008fabfe4 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f269e146c844480c822347c3a38d103b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2b17b61b73b4e6d81dd8ffe9cf311ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:40:05.892464 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-7007174c-4177-45be-a8cb-588008fabfe4 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] 10.222.0.42 "GET /compute/v2.1/servers/6345448b-01b7-4429-bb10-fc5ae449ef71" status: 200 len: 1510 microversion: 2.1 time: 0.237681 Jun 06 10:40:05.903739 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 127/245] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:40:05 2022] GET /compute/v2.1/servers/6345448b-01b7-4429-bb10-fc5ae449ef71 => generated 1510 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:40:06.178797 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-3d47ee25-7f4d-4c79-905e-eaf1c6fdb37f tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '446b13b4661542c097afafb32443dae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3b18ee23fb548709fc513c7e1cfe623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:40:06.191148 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-3d47ee25-7f4d-4c79-905e-eaf1c6fdb37f tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] 10.222.0.42 "GET /compute/v2.1/servers/9063a59c-4c5f-4e65-8fd8-ffc525024f22" status: 200 len: 1313 microversion: 2.1 time: 0.451824 Jun 06 10:40:06.192102 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 119/246] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:40:05 2022] GET /compute/v2.1/servers/9063a59c-4c5f-4e65-8fd8-ffc525024f22 => generated 1313 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 10:40:06.911054 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-ae7b684c-ef16-4ee2-b458-8c1e210b0307 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:40:06.911673 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-ae7b684c-ef16-4ee2-b458-8c1e210b0307 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] [instance: 6345448b-01b7-4429-bb10-fc5ae449ef71] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:40:06.919673 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-ae7b684c-ef16-4ee2-b458-8c1e210b0307 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:40:06.920145 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-ae7b684c-ef16-4ee2-b458-8c1e210b0307 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:40:06.920914 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-ae7b684c-ef16-4ee2-b458-8c1e210b0307 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:40:06.921354 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-ae7b684c-ef16-4ee2-b458-8c1e210b0307 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:40:07.012426 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-5b1d3f50-7c8a-42c8-85db-7776f63c111a tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:40:07.013006 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-5b1d3f50-7c8a-42c8-85db-7776f63c111a tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] [instance: f49079c1-1384-4136-b6cf-eadc40fb5aa1] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:40:07.021212 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-5b1d3f50-7c8a-42c8-85db-7776f63c111a tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:40:07.022113 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-5b1d3f50-7c8a-42c8-85db-7776f63c111a tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:40:07.023242 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-5b1d3f50-7c8a-42c8-85db-7776f63c111a tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:40:07.023723 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-5b1d3f50-7c8a-42c8-85db-7776f63c111a tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:40:07.050120 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-5b1d3f50-7c8a-42c8-85db-7776f63c111a tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] 10.222.0.42 "GET /compute/v2.1/servers/f49079c1-1384-4136-b6cf-eadc40fb5aa1/ips" status: 200 len: 144 microversion: 2.1 time: 0.042494 Jun 06 10:40:07.050690 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 120/247] 10.222.0.42 () {58 vars in 1247 bytes} [Mon Jun 6 10:40:07 2022] GET /compute/v2.1/servers/f49079c1-1384-4136-b6cf-eadc40fb5aa1/ips => generated 144 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 10:40:07.061125 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-ae7b684c-ef16-4ee2-b458-8c1e210b0307 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f269e146c844480c822347c3a38d103b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2b17b61b73b4e6d81dd8ffe9cf311ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:40:07.068672 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-ae7b684c-ef16-4ee2-b458-8c1e210b0307 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] 10.222.0.42 "GET /compute/v2.1/servers/6345448b-01b7-4429-bb10-fc5ae449ef71" status: 200 len: 1516 microversion: 2.1 time: 0.162207 Jun 06 10:40:07.069224 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 128/248] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:40:06 2022] GET /compute/v2.1/servers/6345448b-01b7-4429-bb10-fc5ae449ef71 => generated 1516 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:40:07.210751 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-159bf1d2-92b3-43bf-8228-b441bdac8f5c tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:40:07.211407 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-159bf1d2-92b3-43bf-8228-b441bdac8f5c tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] [instance: 9063a59c-4c5f-4e65-8fd8-ffc525024f22] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:40:07.221239 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-159bf1d2-92b3-43bf-8228-b441bdac8f5c tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:40:07.221853 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-159bf1d2-92b3-43bf-8228-b441bdac8f5c tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:40:07.222998 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-159bf1d2-92b3-43bf-8228-b441bdac8f5c tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:40:07.223716 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-159bf1d2-92b3-43bf-8228-b441bdac8f5c tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:40:07.384570 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-159bf1d2-92b3-43bf-8228-b441bdac8f5c tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '446b13b4661542c097afafb32443dae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3b18ee23fb548709fc513c7e1cfe623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:40:07.394109 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-159bf1d2-92b3-43bf-8228-b441bdac8f5c tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] 10.222.0.42 "GET /compute/v2.1/servers/9063a59c-4c5f-4e65-8fd8-ffc525024f22" status: 200 len: 1313 microversion: 2.1 time: 0.187835 Jun 06 10:40:07.408229 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 121/249] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:40:07 2022] GET /compute/v2.1/servers/9063a59c-4c5f-4e65-8fd8-ffc525024f22 => generated 1313 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:40:08.076584 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [req-83a6912b-d76c-4763-96cc-20d9eeddbcc0 req-dbda1884-0e48-415e-8cec-3ace739a6731 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9063a59c-4c5f-4e65-8fd8-ffc525024f22", "name": "network-vif-plugged", "status": "completed", "tag": "929f39cf-874c-469e-91d2-dd33bf7e85c5"}]} {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 10:40:08.085155 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [req-83a6912b-d76c-4763-96cc-20d9eeddbcc0 req-dbda1884-0e48-415e-8cec-3ace739a6731 service nova] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:40:08.085698 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [req-83a6912b-d76c-4763-96cc-20d9eeddbcc0 req-dbda1884-0e48-415e-8cec-3ace739a6731 service nova] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:40:08.098956 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.compute.server_external_events [req-83a6912b-d76c-4763-96cc-20d9eeddbcc0 req-dbda1884-0e48-415e-8cec-3ace739a6731 service nova] Creating event network-vif-plugged:929f39cf-874c-469e-91d2-dd33bf7e85c5 for instance 9063a59c-4c5f-4e65-8fd8-ffc525024f22 on hv-cinder-84482 Jun 06 10:40:08.116566 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [req-83a6912b-d76c-4763-96cc-20d9eeddbcc0 req-dbda1884-0e48-415e-8cec-3ace739a6731 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043449 Jun 06 10:40:08.117498 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 129/250] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Jun 6 10:40:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 10:40:08.421603 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-82c83747-8296-4bf4-8dc6-eb20dc62cbce tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:40:08.422283 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-82c83747-8296-4bf4-8dc6-eb20dc62cbce tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] [instance: 9063a59c-4c5f-4e65-8fd8-ffc525024f22] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:40:08.432051 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-82c83747-8296-4bf4-8dc6-eb20dc62cbce tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:40:08.432413 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-82c83747-8296-4bf4-8dc6-eb20dc62cbce tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:40:08.438870 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-82c83747-8296-4bf4-8dc6-eb20dc62cbce tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:40:08.439568 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-82c83747-8296-4bf4-8dc6-eb20dc62cbce tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:40:08.491991 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-97f1cfc6-353d-44e2-abc0-c8cb5aec7320 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Action: 'create', calling method: .version_select at 0x7f8fd82b91f0>, body: {"keypair": {"name": "tempest-keypair-993652485", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDK9mrB2syP0u8FACh1H8QR4yoFcjhFrvNcDvA2P8ikai9HOePL863RyPjnJTtGVukPRtPTAuWbS9ATpQcHeYhL5+0khQzHc2VG3NxqWOuboxWPZogG7cgYziUAVwNbg5w=="}} {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 10:40:08.513466 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.quota [None req-97f1cfc6-353d-44e2-abc0-c8cb5aec7320 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Getting quotas for project e2b17b61b73b4e6d81dd8ffe9cf311ea. Resources: {'key_pairs'} {{(pid=129349) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 06 10:40:08.518760 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.quota [None req-97f1cfc6-353d-44e2-abc0-c8cb5aec7320 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Getting quotas for user f269e146c844480c822347c3a38d103b and project e2b17b61b73b4e6d81dd8ffe9cf311ea. Resources: {'key_pairs'} {{(pid=129349) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 06 10:40:08.564098 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-97f1cfc6-353d-44e2-abc0-c8cb5aec7320 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.076389 Jun 06 10:40:08.564705 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 130/251] 10.222.0.42 () {60 vars in 1158 bytes} [Mon Jun 6 10:40:08 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 10:40:08.638497 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-82c83747-8296-4bf4-8dc6-eb20dc62cbce tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '446b13b4661542c097afafb32443dae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3b18ee23fb548709fc513c7e1cfe623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:40:08.648911 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-82c83747-8296-4bf4-8dc6-eb20dc62cbce tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] 10.222.0.42 "GET /compute/v2.1/servers/9063a59c-4c5f-4e65-8fd8-ffc525024f22" status: 200 len: 1313 microversion: 2.1 time: 0.229547 Jun 06 10:40:08.659132 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 122/252] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:40:08 2022] GET /compute/v2.1/servers/9063a59c-4c5f-4e65-8fd8-ffc525024f22 => generated 1313 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 10:40:09.677289 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-bd81f08f-ea08-486d-9dfc-f19dfccb11a2 tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:40:09.686301 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-bd81f08f-ea08-486d-9dfc-f19dfccb11a2 tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] [instance: 9063a59c-4c5f-4e65-8fd8-ffc525024f22] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:40:09.699231 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-bd81f08f-ea08-486d-9dfc-f19dfccb11a2 tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:40:09.700075 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-bd81f08f-ea08-486d-9dfc-f19dfccb11a2 tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:40:09.701126 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-bd81f08f-ea08-486d-9dfc-f19dfccb11a2 tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:40:09.702215 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-bd81f08f-ea08-486d-9dfc-f19dfccb11a2 tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:40:10.012088 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-bd81f08f-ea08-486d-9dfc-f19dfccb11a2 tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '446b13b4661542c097afafb32443dae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3b18ee23fb548709fc513c7e1cfe623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:40:10.021574 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-bd81f08f-ea08-486d-9dfc-f19dfccb11a2 tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] 10.222.0.42 "GET /compute/v2.1/servers/9063a59c-4c5f-4e65-8fd8-ffc525024f22" status: 200 len: 1313 microversion: 2.1 time: 0.359063 Jun 06 10:40:10.022524 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 131/253] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:40:09 2022] GET /compute/v2.1/servers/9063a59c-4c5f-4e65-8fd8-ffc525024f22 => generated 1313 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:40:10.443706 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-6a38c6d3-2347-470a-a82a-4cc48966bd15 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-217239432", "imageRef": "6eea2d98-354d-4083-b74c-abcbb97f9e1a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "da9f0b74-ba8e-4c64-8104-9e13c79c47b6"}], "security_groups": [{"name": "tempest-securitygroup--892443725"}], "key_name": "tempest-keypair-993652485", "user_data": "}} {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 10:40:10.452503 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG dbcounter [-] [129350] Writing DB stats nova_cell0:SELECT=4 {{(pid=129350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 10:40:11.038172 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-440ce885-d413-4f9f-b45d-e4b014b61a89 tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:40:11.038793 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-440ce885-d413-4f9f-b45d-e4b014b61a89 tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] [instance: 9063a59c-4c5f-4e65-8fd8-ffc525024f22] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:40:11.045938 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-440ce885-d413-4f9f-b45d-e4b014b61a89 tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:40:11.046382 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-440ce885-d413-4f9f-b45d-e4b014b61a89 tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:40:11.047322 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-440ce885-d413-4f9f-b45d-e4b014b61a89 tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:40:11.047754 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-440ce885-d413-4f9f-b45d-e4b014b61a89 tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:40:11.189482 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-440ce885-d413-4f9f-b45d-e4b014b61a89 tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '446b13b4661542c097afafb32443dae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3b18ee23fb548709fc513c7e1cfe623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:40:11.209308 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-440ce885-d413-4f9f-b45d-e4b014b61a89 tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] 10.222.0.42 "GET /compute/v2.1/servers/9063a59c-4c5f-4e65-8fd8-ffc525024f22" status: 200 len: 1498 microversion: 2.1 time: 0.174811 Jun 06 10:40:11.210002 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 132/254] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:40:11 2022] GET /compute/v2.1/servers/9063a59c-4c5f-4e65-8fd8-ffc525024f22 => generated 1498 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 10:40:11.592415 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.network.neutron [None req-6a38c6d3-2347-470a-a82a-4cc48966bd15 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] validate_networks() for [('da9f0b74-ba8e-4c64-8104-9e13c79c47b6', None, None, None, None, None)] {{(pid=129350) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 06 10:40:11.928561 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-8e7558f1-6622-48c4-9b7b-a425328dd3fd tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:40:11.929614 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-8e7558f1-6622-48c4-9b7b-a425328dd3fd tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] [instance: 9063a59c-4c5f-4e65-8fd8-ffc525024f22] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:40:11.939330 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-8e7558f1-6622-48c4-9b7b-a425328dd3fd tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:40:11.939990 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-8e7558f1-6622-48c4-9b7b-a425328dd3fd tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:40:11.941097 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-8e7558f1-6622-48c4-9b7b-a425328dd3fd tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:40:11.941694 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-8e7558f1-6622-48c4-9b7b-a425328dd3fd tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:40:11.982870 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-8e7558f1-6622-48c4-9b7b-a425328dd3fd tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] [instance: 9063a59c-4c5f-4e65-8fd8-ffc525024f22] Going to try to terminate instance {{(pid=129349) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 06 10:40:12.071668 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.virt.hardware [None req-6a38c6d3-2347-470a-a82a-4cc48966bd15 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Flavor limits 0:0:0 {{(pid=129350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 06 10:40:12.072328 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.virt.hardware [None req-6a38c6d3-2347-470a-a82a-4cc48966bd15 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Image limits 0:0:0 {{(pid=129350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 06 10:40:12.072978 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.virt.hardware [None req-6a38c6d3-2347-470a-a82a-4cc48966bd15 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Flavor pref 0:0:0 {{(pid=129350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 06 10:40:12.073380 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.virt.hardware [None req-6a38c6d3-2347-470a-a82a-4cc48966bd15 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Image pref 0:0:0 {{(pid=129350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 06 10:40:12.073788 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.virt.hardware [None req-6a38c6d3-2347-470a-a82a-4cc48966bd15 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 06 10:40:12.088626 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-6a38c6d3-2347-470a-a82a-4cc48966bd15 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:40:12.089378 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-6a38c6d3-2347-470a-a82a-4cc48966bd15 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:40:12.090824 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-6a38c6d3-2347-470a-a82a-4cc48966bd15 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:40:12.091849 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-6a38c6d3-2347-470a-a82a-4cc48966bd15 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:40:12.099702 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-8e7558f1-6622-48c4-9b7b-a425328dd3fd tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] 10.222.0.42 "DELETE /compute/v2.1/servers/9063a59c-4c5f-4e65-8fd8-ffc525024f22" status: 204 len: 0 microversion: 2.1 time: 0.175735 Jun 06 10:40:12.101353 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 133/255] 10.222.0.42 () {58 vars in 1238 bytes} [Mon Jun 6 10:40:11 2022] DELETE /compute/v2.1/servers/9063a59c-4c5f-4e65-8fd8-ffc525024f22 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 06 10:40:12.112653 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-3fa3c39f-a579-4d7d-9026-90fe1671c627 tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:40:12.114154 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-3fa3c39f-a579-4d7d-9026-90fe1671c627 tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] [instance: 9063a59c-4c5f-4e65-8fd8-ffc525024f22] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:40:12.121564 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-3fa3c39f-a579-4d7d-9026-90fe1671c627 tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:40:12.122007 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-3fa3c39f-a579-4d7d-9026-90fe1671c627 tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:40:12.122159 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.quota [None req-6a38c6d3-2347-470a-a82a-4cc48966bd15 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Getting quotas for project e2b17b61b73b4e6d81dd8ffe9cf311ea. Resources: {'ram', 'cores', 'instances'} {{(pid=129350) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 06 10:40:12.123226 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-3fa3c39f-a579-4d7d-9026-90fe1671c627 tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:40:12.123668 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-3fa3c39f-a579-4d7d-9026-90fe1671c627 tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:40:12.134698 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.quota [None req-6a38c6d3-2347-470a-a82a-4cc48966bd15 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Getting quotas for user f269e146c844480c822347c3a38d103b and project e2b17b61b73b4e6d81dd8ffe9cf311ea. Resources: {'ram', 'cores', 'instances'} {{(pid=129350) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 06 10:40:12.151848 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-6a38c6d3-2347-470a-a82a-4cc48966bd15 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Going to run 1 instances... {{(pid=129350) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 06 10:40:12.154734 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-6a38c6d3-2347-470a-a82a-4cc48966bd15 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] [instance: d4d7ae82-4a52-4e0e-87b5-13a5b95cc3a0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6eea2d98-354d-4083-b74c-abcbb97f9e1a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129350) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 06 10:40:12.218828 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-6a38c6d3-2347-470a-a82a-4cc48966bd15 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 1.779420 Jun 06 10:40:12.219996 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 123/256] 10.222.0.42 () {60 vars in 1146 bytes} [Mon Jun 6 10:40:10 2022] POST /compute/v2.1/servers => generated 408 bytes in 1781 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 06 10:40:12.237274 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-979e1674-db5a-46e0-8f33-21a0be63057c tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:40:12.240682 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-979e1674-db5a-46e0-8f33-21a0be63057c tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] [instance: d4d7ae82-4a52-4e0e-87b5-13a5b95cc3a0] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:40:12.344306 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-979e1674-db5a-46e0-8f33-21a0be63057c tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f269e146c844480c822347c3a38d103b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2b17b61b73b4e6d81dd8ffe9cf311ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:40:12.352424 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-979e1674-db5a-46e0-8f33-21a0be63057c tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] 10.222.0.42 "GET /compute/v2.1/servers/d4d7ae82-4a52-4e0e-87b5-13a5b95cc3a0" status: 200 len: 1244 microversion: 2.1 time: 0.126355 Jun 06 10:40:12.353335 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 124/257] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:40:12 2022] GET /compute/v2.1/servers/d4d7ae82-4a52-4e0e-87b5-13a5b95cc3a0 => generated 1244 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:40:12.379218 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-3fa3c39f-a579-4d7d-9026-90fe1671c627 tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '446b13b4661542c097afafb32443dae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3b18ee23fb548709fc513c7e1cfe623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:40:12.396033 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-3fa3c39f-a579-4d7d-9026-90fe1671c627 tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] 10.222.0.42 "GET /compute/v2.1/servers/9063a59c-4c5f-4e65-8fd8-ffc525024f22" status: 200 len: 1504 microversion: 2.1 time: 0.288306 Jun 06 10:40:12.396629 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 134/258] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:40:12 2022] GET /compute/v2.1/servers/9063a59c-4c5f-4e65-8fd8-ffc525024f22 => generated 1504 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:40:13.369521 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-2b81a1c4-004e-4c73-a42c-353957fffda4 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:40:13.370213 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-2b81a1c4-004e-4c73-a42c-353957fffda4 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] [instance: d4d7ae82-4a52-4e0e-87b5-13a5b95cc3a0] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:40:13.376262 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-2b81a1c4-004e-4c73-a42c-353957fffda4 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:40:13.376704 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-2b81a1c4-004e-4c73-a42c-353957fffda4 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:40:13.377900 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-2b81a1c4-004e-4c73-a42c-353957fffda4 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:40:13.378570 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-2b81a1c4-004e-4c73-a42c-353957fffda4 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:40:13.416722 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-2cbf11da-b1d5-45dc-933f-7f055c19e65d tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:40:13.417334 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-2cbf11da-b1d5-45dc-933f-7f055c19e65d tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] [instance: 9063a59c-4c5f-4e65-8fd8-ffc525024f22] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:40:13.424090 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-2cbf11da-b1d5-45dc-933f-7f055c19e65d tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:40:13.424532 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-2cbf11da-b1d5-45dc-933f-7f055c19e65d tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:40:13.425304 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-2cbf11da-b1d5-45dc-933f-7f055c19e65d tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:40:13.426097 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-2cbf11da-b1d5-45dc-933f-7f055c19e65d tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:40:13.469239 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-2b81a1c4-004e-4c73-a42c-353957fffda4 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f269e146c844480c822347c3a38d103b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2b17b61b73b4e6d81dd8ffe9cf311ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:40:13.487098 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-2b81a1c4-004e-4c73-a42c-353957fffda4 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] 10.222.0.42 "GET /compute/v2.1/servers/d4d7ae82-4a52-4e0e-87b5-13a5b95cc3a0" status: 200 len: 1248 microversion: 2.1 time: 0.121689 Jun 06 10:40:13.487664 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 125/259] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:40:13 2022] GET /compute/v2.1/servers/d4d7ae82-4a52-4e0e-87b5-13a5b95cc3a0 => generated 1248 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:40:13.543801 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-a1e661d9-f743-4001-a256-a06688429930 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:40:13.544479 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-a1e661d9-f743-4001-a256-a06688429930 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] [instance: 5a0a79a6-8e61-477e-8269-730dfb6d04a6] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:40:13.550805 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-a1e661d9-f743-4001-a256-a06688429930 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:40:13.551239 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-a1e661d9-f743-4001-a256-a06688429930 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:40:13.552034 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-a1e661d9-f743-4001-a256-a06688429930 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:40:13.552464 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-a1e661d9-f743-4001-a256-a06688429930 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:40:13.583445 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-a1e661d9-f743-4001-a256-a06688429930 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0a79a6-8e61-477e-8269-730dfb6d04a6/ips" status: 200 len: 151 microversion: 2.20 time: 0.044304 Jun 06 10:40:13.584021 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 126/260] 10.222.0.42 () {60 vars in 1288 bytes} [Mon Jun 6 10:40:13 2022] GET /compute/v2.1/servers/5a0a79a6-8e61-477e-8269-730dfb6d04a6/ips => generated 151 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 06 10:40:13.625281 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-2cbf11da-b1d5-45dc-933f-7f055c19e65d tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '446b13b4661542c097afafb32443dae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3b18ee23fb548709fc513c7e1cfe623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:40:13.637893 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-2cbf11da-b1d5-45dc-933f-7f055c19e65d tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] 10.222.0.42 "GET /compute/v2.1/servers/9063a59c-4c5f-4e65-8fd8-ffc525024f22" status: 200 len: 1504 microversion: 2.1 time: 0.225193 Jun 06 10:40:13.638994 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 135/261] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:40:13 2022] GET /compute/v2.1/servers/9063a59c-4c5f-4e65-8fd8-ffc525024f22 => generated 1504 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:40:14.083475 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-db16f13e-7219-4a61-a311-1541254b4c25 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0d9d5a60-9d11-4a3c-9098-bd81642ee939"}} {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 10:40:14.084700 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-db16f13e-7219-4a61-a311-1541254b4c25 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] [instance: f49079c1-1384-4136-b6cf-eadc40fb5aa1] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:40:14.091728 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-db16f13e-7219-4a61-a311-1541254b4c25 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:40:14.092201 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-db16f13e-7219-4a61-a311-1541254b4c25 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:40:14.092967 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-db16f13e-7219-4a61-a311-1541254b4c25 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:40:14.093400 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-db16f13e-7219-4a61-a311-1541254b4c25 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:40:14.507638 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-e22dc2a0-c02f-4878-8dac-2e07b16de929 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:40:14.513291 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-e22dc2a0-c02f-4878-8dac-2e07b16de929 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] [instance: d4d7ae82-4a52-4e0e-87b5-13a5b95cc3a0] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:40:14.530193 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-e22dc2a0-c02f-4878-8dac-2e07b16de929 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:40:14.530977 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-e22dc2a0-c02f-4878-8dac-2e07b16de929 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:40:14.531999 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-e22dc2a0-c02f-4878-8dac-2e07b16de929 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:40:14.532907 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-e22dc2a0-c02f-4878-8dac-2e07b16de929 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:40:14.668761 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-e22dc2a0-c02f-4878-8dac-2e07b16de929 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f269e146c844480c822347c3a38d103b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2b17b61b73b4e6d81dd8ffe9cf311ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:40:14.679711 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-e22dc2a0-c02f-4878-8dac-2e07b16de929 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] 10.222.0.42 "GET /compute/v2.1/servers/d4d7ae82-4a52-4e0e-87b5-13a5b95cc3a0" status: 200 len: 1296 microversion: 2.1 time: 0.177422 Jun 06 10:40:14.681135 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 136/262] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:40:14 2022] GET /compute/v2.1/servers/d4d7ae82-4a52-4e0e-87b5-13a5b95cc3a0 => generated 1296 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:40:14.686505 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-5acc65de-6130-4bc9-bfa6-5d8c84903bd7 tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:40:14.687422 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-5acc65de-6130-4bc9-bfa6-5d8c84903bd7 tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] [instance: 9063a59c-4c5f-4e65-8fd8-ffc525024f22] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:40:14.698456 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-5acc65de-6130-4bc9-bfa6-5d8c84903bd7 tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:40:14.699192 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-5acc65de-6130-4bc9-bfa6-5d8c84903bd7 tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:40:14.701840 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-5acc65de-6130-4bc9-bfa6-5d8c84903bd7 tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:40:14.702653 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-5acc65de-6130-4bc9-bfa6-5d8c84903bd7 tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:40:14.711037 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG dbcounter [-] [129349] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=129349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 10:40:14.840219 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-db16f13e-7219-4a61-a311-1541254b4c25 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] 10.222.0.42 "POST /compute/v2.1/servers/f49079c1-1384-4136-b6cf-eadc40fb5aa1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.759023 Jun 06 10:40:14.843637 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 127/263] 10.222.0.42 () {60 vars in 1322 bytes} [Mon Jun 6 10:40:14 2022] POST /compute/v2.1/servers/f49079c1-1384-4136-b6cf-eadc40fb5aa1/os-volume_attachments => generated 194 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 10:40:15.113681 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-5acc65de-6130-4bc9-bfa6-5d8c84903bd7 tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '446b13b4661542c097afafb32443dae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3b18ee23fb548709fc513c7e1cfe623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:40:15.126499 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-5acc65de-6130-4bc9-bfa6-5d8c84903bd7 tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] 10.222.0.42 "GET /compute/v2.1/servers/9063a59c-4c5f-4e65-8fd8-ffc525024f22" status: 200 len: 1504 microversion: 2.1 time: 0.443982 Jun 06 10:40:15.127329 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 137/264] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:40:14 2022] GET /compute/v2.1/servers/9063a59c-4c5f-4e65-8fd8-ffc525024f22 => generated 1504 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:40:15.579406 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [req-b3e6e5bd-6ab8-4cea-af67-593af67fdeea req-f5f8f4f9-7947-4838-a47b-dc897b969095 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9063a59c-4c5f-4e65-8fd8-ffc525024f22", "name": "network-vif-deleted", "tag": "929f39cf-874c-469e-91d2-dd33bf7e85c5"}]} {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 10:40:15.606813 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [req-b3e6e5bd-6ab8-4cea-af67-593af67fdeea req-f5f8f4f9-7947-4838-a47b-dc897b969095 service nova] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:40:15.608000 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [req-b3e6e5bd-6ab8-4cea-af67-593af67fdeea req-f5f8f4f9-7947-4838-a47b-dc897b969095 service nova] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:40:15.642410 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.compute.server_external_events [req-b3e6e5bd-6ab8-4cea-af67-593af67fdeea req-f5f8f4f9-7947-4838-a47b-dc897b969095 service nova] Creating event network-vif-deleted:929f39cf-874c-469e-91d2-dd33bf7e85c5 for instance 9063a59c-4c5f-4e65-8fd8-ffc525024f22 on hv-cinder-84482 Jun 06 10:40:15.653048 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [req-b3e6e5bd-6ab8-4cea-af67-593af67fdeea req-f5f8f4f9-7947-4838-a47b-dc897b969095 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077736 Jun 06 10:40:15.654918 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 128/265] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Jun 6 10:40:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 10:40:15.699744 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-709241d0-022c-45fe-82f4-bddc909d172c tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:40:15.700445 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-709241d0-022c-45fe-82f4-bddc909d172c tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] [instance: d4d7ae82-4a52-4e0e-87b5-13a5b95cc3a0] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:40:15.707012 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-709241d0-022c-45fe-82f4-bddc909d172c tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:40:15.707453 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-709241d0-022c-45fe-82f4-bddc909d172c tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:40:15.708254 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-709241d0-022c-45fe-82f4-bddc909d172c tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:40:15.708688 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-709241d0-022c-45fe-82f4-bddc909d172c tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:40:15.992572 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-709241d0-022c-45fe-82f4-bddc909d172c tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f269e146c844480c822347c3a38d103b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2b17b61b73b4e6d81dd8ffe9cf311ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:40:16.005294 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-709241d0-022c-45fe-82f4-bddc909d172c tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] 10.222.0.42 "GET /compute/v2.1/servers/d4d7ae82-4a52-4e0e-87b5-13a5b95cc3a0" status: 200 len: 1302 microversion: 2.1 time: 0.311167 Jun 06 10:40:16.006287 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 138/266] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:40:15 2022] GET /compute/v2.1/servers/d4d7ae82-4a52-4e0e-87b5-13a5b95cc3a0 => generated 1302 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:40:16.112440 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-dd2948e4-1b76-45df-8f69-fcd8f3b63021 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 10:40:16.113328 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-dd2948e4-1b76-45df-8f69-fcd8f3b63021 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] [instance: 5a0a79a6-8e61-477e-8269-730dfb6d04a6] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:40:16.129155 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-dd2948e4-1b76-45df-8f69-fcd8f3b63021 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:40:16.130556 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-dd2948e4-1b76-45df-8f69-fcd8f3b63021 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:40:16.132055 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-dd2948e4-1b76-45df-8f69-fcd8f3b63021 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:40:16.133064 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-dd2948e4-1b76-45df-8f69-fcd8f3b63021 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:40:16.146886 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-782b6fb1-e969-4a94-9fc5-69d8ce0fa3c3 tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:40:16.147703 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-782b6fb1-e969-4a94-9fc5-69d8ce0fa3c3 tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] [instance: 9063a59c-4c5f-4e65-8fd8-ffc525024f22] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:40:16.170757 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.objects.instance [None req-dd2948e4-1b76-45df-8f69-fcd8f3b63021 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lazy-loading 'flavor' on Instance uuid 5a0a79a6-8e61-477e-8269-730dfb6d04a6 {{(pid=129350) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 06 10:40:16.182143 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-782b6fb1-e969-4a94-9fc5-69d8ce0fa3c3 tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:40:16.185143 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-782b6fb1-e969-4a94-9fc5-69d8ce0fa3c3 tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:40:16.187019 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-782b6fb1-e969-4a94-9fc5-69d8ce0fa3c3 tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:40:16.188156 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-782b6fb1-e969-4a94-9fc5-69d8ce0fa3c3 tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:40:16.249471 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-782b6fb1-e969-4a94-9fc5-69d8ce0fa3c3 tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:40:16.250313 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-782b6fb1-e969-4a94-9fc5-69d8ce0fa3c3 tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:40:16.251115 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.objects.instance [None req-782b6fb1-e969-4a94-9fc5-69d8ce0fa3c3 tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] Lazy-loading 'fault' on Instance uuid 9063a59c-4c5f-4e65-8fd8-ffc525024f22 {{(pid=129349) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 06 10:40:16.272187 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG dbcounter [-] [129350] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=4,nova_cell1:INSERT=1 {{(pid=129350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 10:40:16.358862 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-782b6fb1-e969-4a94-9fc5-69d8ce0fa3c3 tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '446b13b4661542c097afafb32443dae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3b18ee23fb548709fc513c7e1cfe623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:40:16.367054 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-782b6fb1-e969-4a94-9fc5-69d8ce0fa3c3 tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] 10.222.0.42 "GET /compute/v2.1/servers/9063a59c-4c5f-4e65-8fd8-ffc525024f22" status: 200 len: 1303 microversion: 2.1 time: 0.225832 Jun 06 10:40:16.368478 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 139/267] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:40:16 2022] GET /compute/v2.1/servers/9063a59c-4c5f-4e65-8fd8-ffc525024f22 => generated 1303 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 10:40:17.025072 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-60073af6-bb04-4987-87ef-6fcae59b1bd6 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:40:17.025712 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-60073af6-bb04-4987-87ef-6fcae59b1bd6 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] [instance: d4d7ae82-4a52-4e0e-87b5-13a5b95cc3a0] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:40:17.034018 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-60073af6-bb04-4987-87ef-6fcae59b1bd6 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:40:17.038002 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-60073af6-bb04-4987-87ef-6fcae59b1bd6 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:40:17.040466 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-60073af6-bb04-4987-87ef-6fcae59b1bd6 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:40:17.044467 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-60073af6-bb04-4987-87ef-6fcae59b1bd6 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:40:17.410131 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-60073af6-bb04-4987-87ef-6fcae59b1bd6 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f269e146c844480c822347c3a38d103b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2b17b61b73b4e6d81dd8ffe9cf311ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:40:17.417906 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-60073af6-bb04-4987-87ef-6fcae59b1bd6 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] 10.222.0.42 "GET /compute/v2.1/servers/d4d7ae82-4a52-4e0e-87b5-13a5b95cc3a0" status: 200 len: 1369 microversion: 2.1 time: 0.397212 Jun 06 10:40:17.418406 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 140/268] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:40:17 2022] GET /compute/v2.1/servers/d4d7ae82-4a52-4e0e-87b5-13a5b95cc3a0 => generated 1369 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 10:40:17.422979 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-20fcc702-aaab-4060-865f-8441159e4cb3 tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:40:17.423828 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-20fcc702-aaab-4060-865f-8441159e4cb3 tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] [instance: 9063a59c-4c5f-4e65-8fd8-ffc525024f22] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:40:17.430221 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-20fcc702-aaab-4060-865f-8441159e4cb3 tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:40:17.430675 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-20fcc702-aaab-4060-865f-8441159e4cb3 tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:40:17.431558 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-20fcc702-aaab-4060-865f-8441159e4cb3 tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:40:17.432021 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-20fcc702-aaab-4060-865f-8441159e4cb3 tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:40:17.445459 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.wsgi [None req-20fcc702-aaab-4060-865f-8441159e4cb3 tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] HTTP exception thrown: Instance 9063a59c-4c5f-4e65-8fd8-ffc525024f22 could not be found. Jun 06 10:40:17.448049 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-20fcc702-aaab-4060-865f-8441159e4cb3 tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] Request method failure captured: Jun 06 10:40:17.448049 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: request: GET /compute/v2.1/servers/9063a59c-4c5f-4e65-8fd8-ffc525024f22 HTTP/1.1 Jun 06 10:40:17.448049 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: Accept: application/json Jun 06 10:40:17.448049 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: Accept-Encoding: identity Jun 06 10:40:17.448049 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: Connection: close Jun 06 10:40:17.448049 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: Content-Length: 0 Jun 06 10:40:17.448049 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: Content-Type: application/json Jun 06 10:40:17.448049 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: Host: 10.222.0.42 Jun 06 10:40:17.448049 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: Openstack-System-Scope: None Jun 06 10:40:17.448049 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: User-Agent: python-urllib3/1.26.9 Jun 06 10:40:17.448049 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Auth-Token: gAAAAABindlTmMmKURqxAThEr20DIZo-50DAUNsGyKrXEJEOhhSwHuNvioaK_PXKLhf6ygxQLHoYb1RflIucd4kfAn4hWm07mgHV8oRtM5QUL0VwdWFBVRnUSQYoVxLxV3O-gLuxqor80eoHvP7WqCL7jrQ3a32In_nlLkOTwuhh2IpMLlPubpI Jun 06 10:40:17.448049 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Domain-Id: None Jun 06 10:40:17.448049 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Domain-Name: None Jun 06 10:40:17.448049 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Identity-Status: Confirmed Jun 06 10:40:17.448049 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Is-Admin-Project: True Jun 06 10:40:17.448049 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Project-Domain-Id: default Jun 06 10:40:17.448049 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Project-Domain-Name: Default Jun 06 10:40:17.448049 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Project-Id: b3b18ee23fb548709fc513c7e1cfe623 Jun 06 10:40:17.448049 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Project-Name: tempest-VolumesActionsTest-595691019 Jun 06 10:40:17.448049 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Role: member,reader Jun 06 10:40:17.448049 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Roles: member,reader Jun 06 10:40:17.449342 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/b3b18ee23fb548709fc513c7e1cfe623"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b3b18ee23fb548709fc513c7e1cfe623"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b3b18ee23fb548709fc513c7e1cfe623"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_b3b18ee23fb548709fc513c7e1cfe623", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Jun 06 10:40:17.449342 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Tenant: tempest-VolumesActionsTest-595691019 Jun 06 10:40:17.449342 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Tenant-Id: b3b18ee23fb548709fc513c7e1cfe623 Jun 06 10:40:17.449342 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Tenant-Name: tempest-VolumesActionsTest-595691019 Jun 06 10:40:17.449342 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-User: tempest-VolumesActionsTest-595691019-project Jun 06 10:40:17.449342 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-User-Domain-Id: default Jun 06 10:40:17.449342 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-User-Domain-Name: Default Jun 06 10:40:17.449342 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-User-Id: 446b13b4661542c097afafb32443dae4 Jun 06 10:40:17.449342 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-User-Name: tempest-VolumesActionsTest-595691019-project Jun 06 10:40:17.449342 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: method: > Jun 06 10:40:17.449342 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: exception: Instance 9063a59c-4c5f-4e65-8fd8-ffc525024f22 could not be found. Jun 06 10:40:17.449342 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: action_args: {'id': '9063a59c-4c5f-4e65-8fd8-ffc525024f22'} Jun 06 10:40:17.450039 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 10:40:17.450039 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 10:40:17.450039 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 06 10:40:17.450039 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 06 10:40:17.450039 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 06 10:40:17.450039 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 06 10:40:17.450039 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 06 10:40:17.450039 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 06 10:40:17.450039 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 06 10:40:17.450039 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 06 10:40:17.450039 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9063a59c-4c5f-4e65-8fd8-ffc525024f22 could not be found. Jun 06 10:40:17.450039 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Jun 06 10:40:17.450039 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 10:40:17.450039 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Jun 06 10:40:17.450039 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 10:40:17.450039 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 10:40:17.450039 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 10:40:17.450039 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 10:40:17.450039 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 10:40:17.450039 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 10:40:17.451637 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 10:40:17.451637 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 06 10:40:17.451637 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 06 10:40:17.451637 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 06 10:40:17.451637 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 06 10:40:17.451637 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 06 10:40:17.451637 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 06 10:40:17.451637 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9063a59c-4c5f-4e65-8fd8-ffc525024f22 could not be found. Jun 06 10:40:17.451637 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Jun 06 10:40:17.451637 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 10:40:17.451637 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Jun 06 10:40:17.451637 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 10:40:17.451637 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 10:40:17.451637 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 10:40:17.451637 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 10:40:17.451637 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 10:40:17.451637 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9063a59c-4c5f-4e65-8fd8-ffc525024f22 could not be found. Jun 06 10:40:17.451637 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Jun 06 10:40:17.452732 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-20fcc702-aaab-4060-865f-8441159e4cb3 tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] Returning 404 to user: Instance 9063a59c-4c5f-4e65-8fd8-ffc525024f22 could not be found. {{(pid=129349) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 10:40:17.452732 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-20fcc702-aaab-4060-865f-8441159e4cb3 tempest-VolumesActionsTest-595691019 tempest-VolumesActionsTest-595691019-project] 10.222.0.42 "GET /compute/v2.1/servers/9063a59c-4c5f-4e65-8fd8-ffc525024f22" status: 404 len: 111 microversion: 2.1 time: 0.030119 Jun 06 10:40:17.452732 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 141/269] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:40:17 2022] GET /compute/v2.1/servers/9063a59c-4c5f-4e65-8fd8-ffc525024f22 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 06 10:40:17.669893 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [req-f14f9925-de9e-49b8-9a67-fc7c1baff182 req-8fa61845-682c-4c21-9be9-5089bbe6d8e1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d4d7ae82-4a52-4e0e-87b5-13a5b95cc3a0", "tag": "c4ec0cb9-f04f-437e-bf0f-93e81d012b38"}]} {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 10:40:17.685154 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [req-f14f9925-de9e-49b8-9a67-fc7c1baff182 req-8fa61845-682c-4c21-9be9-5089bbe6d8e1 service nova] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:40:17.685833 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [req-f14f9925-de9e-49b8-9a67-fc7c1baff182 req-8fa61845-682c-4c21-9be9-5089bbe6d8e1 service nova] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:40:17.712091 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.compute.server_external_events [req-f14f9925-de9e-49b8-9a67-fc7c1baff182 req-8fa61845-682c-4c21-9be9-5089bbe6d8e1 service nova] Creating event network-changed:c4ec0cb9-f04f-437e-bf0f-93e81d012b38 for instance d4d7ae82-4a52-4e0e-87b5-13a5b95cc3a0 on hv-cinder-84482 Jun 06 10:40:17.719983 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [req-f14f9925-de9e-49b8-9a67-fc7c1baff182 req-8fa61845-682c-4c21-9be9-5089bbe6d8e1 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056686 Jun 06 10:40:17.721352 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 142/270] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Jun 6 10:40:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 06 10:40:18.440524 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-3151ac95-09be-461a-8d2c-212145acc3ec tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:40:18.441433 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-3151ac95-09be-461a-8d2c-212145acc3ec tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] [instance: d4d7ae82-4a52-4e0e-87b5-13a5b95cc3a0] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:40:18.448190 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-3151ac95-09be-461a-8d2c-212145acc3ec tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:40:18.448943 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-3151ac95-09be-461a-8d2c-212145acc3ec tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:40:18.449699 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-3151ac95-09be-461a-8d2c-212145acc3ec tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:40:18.450134 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-3151ac95-09be-461a-8d2c-212145acc3ec tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:40:18.528128 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG dbcounter [-] [129349] Writing DB stats nova_cell0:SELECT=4 {{(pid=129349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 10:40:18.604759 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-3151ac95-09be-461a-8d2c-212145acc3ec tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f269e146c844480c822347c3a38d103b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2b17b61b73b4e6d81dd8ffe9cf311ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:40:18.612115 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-3151ac95-09be-461a-8d2c-212145acc3ec tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] 10.222.0.42 "GET /compute/v2.1/servers/d4d7ae82-4a52-4e0e-87b5-13a5b95cc3a0" status: 200 len: 1369 microversion: 2.1 time: 0.177445 Jun 06 10:40:18.612673 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 143/271] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:40:18 2022] GET /compute/v2.1/servers/d4d7ae82-4a52-4e0e-87b5-13a5b95cc3a0 => generated 1369 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 10:40:19.629002 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-c1b8eba4-c0d3-44d0-95c1-c7989147ec5c tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:40:19.629637 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-c1b8eba4-c0d3-44d0-95c1-c7989147ec5c tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] [instance: d4d7ae82-4a52-4e0e-87b5-13a5b95cc3a0] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:40:19.636418 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-c1b8eba4-c0d3-44d0-95c1-c7989147ec5c tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:40:19.636836 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-c1b8eba4-c0d3-44d0-95c1-c7989147ec5c tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:40:19.637865 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-c1b8eba4-c0d3-44d0-95c1-c7989147ec5c tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:40:19.638305 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-c1b8eba4-c0d3-44d0-95c1-c7989147ec5c tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:40:19.788594 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-c1b8eba4-c0d3-44d0-95c1-c7989147ec5c tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f269e146c844480c822347c3a38d103b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2b17b61b73b4e6d81dd8ffe9cf311ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:40:19.797376 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-c1b8eba4-c0d3-44d0-95c1-c7989147ec5c tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] 10.222.0.42 "GET /compute/v2.1/servers/d4d7ae82-4a52-4e0e-87b5-13a5b95cc3a0" status: 200 len: 1369 microversion: 2.1 time: 0.172125 Jun 06 10:40:19.798236 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 144/272] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:40:19 2022] GET /compute/v2.1/servers/d4d7ae82-4a52-4e0e-87b5-13a5b95cc3a0 => generated 1369 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 10:40:20.816338 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-d82adf01-e523-4c80-9960-cbb1dbada322 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:40:20.816960 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-d82adf01-e523-4c80-9960-cbb1dbada322 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] [instance: d4d7ae82-4a52-4e0e-87b5-13a5b95cc3a0] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:40:20.824082 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-d82adf01-e523-4c80-9960-cbb1dbada322 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:40:20.824533 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-d82adf01-e523-4c80-9960-cbb1dbada322 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:40:20.825303 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-d82adf01-e523-4c80-9960-cbb1dbada322 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:40:20.825735 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-d82adf01-e523-4c80-9960-cbb1dbada322 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:40:20.959358 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-d82adf01-e523-4c80-9960-cbb1dbada322 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f269e146c844480c822347c3a38d103b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2b17b61b73b4e6d81dd8ffe9cf311ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:40:20.967115 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-d82adf01-e523-4c80-9960-cbb1dbada322 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] 10.222.0.42 "GET /compute/v2.1/servers/d4d7ae82-4a52-4e0e-87b5-13a5b95cc3a0" status: 200 len: 1369 microversion: 2.1 time: 0.156596 Jun 06 10:40:20.967730 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 145/273] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:40:20 2022] GET /compute/v2.1/servers/d4d7ae82-4a52-4e0e-87b5-13a5b95cc3a0 => generated 1369 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:40:21.985145 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-04ed20e1-83be-4a54-b1dc-c3a316f18dd1 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:40:21.985916 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-04ed20e1-83be-4a54-b1dc-c3a316f18dd1 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] [instance: d4d7ae82-4a52-4e0e-87b5-13a5b95cc3a0] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:40:21.994055 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-04ed20e1-83be-4a54-b1dc-c3a316f18dd1 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:40:21.994504 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-04ed20e1-83be-4a54-b1dc-c3a316f18dd1 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:40:21.995490 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-04ed20e1-83be-4a54-b1dc-c3a316f18dd1 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:40:21.995973 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-04ed20e1-83be-4a54-b1dc-c3a316f18dd1 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:40:22.111119 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG dbcounter [-] [129350] Writing DB stats nova_cell0:SELECT=2 {{(pid=129350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 10:40:22.175246 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-04ed20e1-83be-4a54-b1dc-c3a316f18dd1 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f269e146c844480c822347c3a38d103b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2b17b61b73b4e6d81dd8ffe9cf311ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:40:22.183266 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-04ed20e1-83be-4a54-b1dc-c3a316f18dd1 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] 10.222.0.42 "GET /compute/v2.1/servers/d4d7ae82-4a52-4e0e-87b5-13a5b95cc3a0" status: 200 len: 1369 microversion: 2.1 time: 0.202706 Jun 06 10:40:22.184073 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 146/274] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:40:21 2022] GET /compute/v2.1/servers/d4d7ae82-4a52-4e0e-87b5-13a5b95cc3a0 => generated 1369 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:40:22.199135 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [req-7c9b8d96-bd36-4f67-871a-c826eeca81a0 req-c1ac8d10-982d-4365-acc8-81010dcd781a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4d7ae82-4a52-4e0e-87b5-13a5b95cc3a0", "name": "network-vif-plugged", "status": "completed", "tag": "c4ec0cb9-f04f-437e-bf0f-93e81d012b38"}]} {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 10:40:22.208051 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [req-7c9b8d96-bd36-4f67-871a-c826eeca81a0 req-c1ac8d10-982d-4365-acc8-81010dcd781a service nova] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:40:22.208490 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [req-7c9b8d96-bd36-4f67-871a-c826eeca81a0 req-c1ac8d10-982d-4365-acc8-81010dcd781a service nova] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:40:22.221180 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.compute.server_external_events [req-7c9b8d96-bd36-4f67-871a-c826eeca81a0 req-c1ac8d10-982d-4365-acc8-81010dcd781a service nova] Creating event network-vif-plugged:c4ec0cb9-f04f-437e-bf0f-93e81d012b38 for instance d4d7ae82-4a52-4e0e-87b5-13a5b95cc3a0 on hv-cinder-84482 Jun 06 10:40:22.225735 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [req-7c9b8d96-bd36-4f67-871a-c826eeca81a0 req-c1ac8d10-982d-4365-acc8-81010dcd781a service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040491 Jun 06 10:40:22.226575 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 147/275] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Jun 6 10:40:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 10:40:22.349184 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG dbcounter [-] [129350] Writing DB stats nova_cell0:SELECT=8 {{(pid=129350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 10:40:22.852605 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-122e2008-540a-4414-819c-91afe685d082 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 10:40:22.858764 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-122e2008-540a-4414-819c-91afe685d082 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:40:22.859204 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-122e2008-540a-4414-819c-91afe685d082 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:40:22.922624 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-122e2008-540a-4414-819c-91afe685d082 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] [instance: f49079c1-1384-4136-b6cf-eadc40fb5aa1] Going to try to stop instance {{(pid=129349) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 06 10:40:22.967195 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-122e2008-540a-4414-819c-91afe685d082 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] 10.222.0.42 "POST /compute/v2.1/servers/f49079c1-1384-4136-b6cf-eadc40fb5aa1/action" status: 202 len: 0 microversion: 2.1 time: 0.118817 Jun 06 10:40:22.967974 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 148/276] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Jun 6 10:40:22 2022] POST /compute/v2.1/servers/f49079c1-1384-4136-b6cf-eadc40fb5aa1/action => generated 0 bytes in 121 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 06 10:40:22.976049 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-73c313cc-adb2-449c-9dd6-a0fa7d3c7ee7 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:40:22.976761 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-73c313cc-adb2-449c-9dd6-a0fa7d3c7ee7 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] [instance: f49079c1-1384-4136-b6cf-eadc40fb5aa1] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:40:22.985489 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-73c313cc-adb2-449c-9dd6-a0fa7d3c7ee7 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:40:22.986074 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-73c313cc-adb2-449c-9dd6-a0fa7d3c7ee7 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:40:22.986799 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-73c313cc-adb2-449c-9dd6-a0fa7d3c7ee7 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:40:22.987498 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-73c313cc-adb2-449c-9dd6-a0fa7d3c7ee7 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:40:23.132659 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-73c313cc-adb2-449c-9dd6-a0fa7d3c7ee7 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b7d82c999646b6b6b96d565f0e3f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe30c756a2f84166ad23af1edf83157e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:40:23.141589 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-73c313cc-adb2-449c-9dd6-a0fa7d3c7ee7 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] 10.222.0.42 "GET /compute/v2.1/servers/f49079c1-1384-4136-b6cf-eadc40fb5aa1" status: 200 len: 1722 microversion: 2.1 time: 0.169466 Jun 06 10:40:23.142144 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 149/277] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:40:22 2022] GET /compute/v2.1/servers/f49079c1-1384-4136-b6cf-eadc40fb5aa1 => generated 1722 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 10:40:23.202731 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-af934d05-916d-4b51-951e-ee1451fdad3b tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:40:23.203562 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-af934d05-916d-4b51-951e-ee1451fdad3b tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] [instance: d4d7ae82-4a52-4e0e-87b5-13a5b95cc3a0] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:40:23.209936 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-af934d05-916d-4b51-951e-ee1451fdad3b tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:40:23.210373 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-af934d05-916d-4b51-951e-ee1451fdad3b tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:40:23.211236 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-af934d05-916d-4b51-951e-ee1451fdad3b tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:40:23.211706 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-af934d05-916d-4b51-951e-ee1451fdad3b tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:40:23.344898 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-af934d05-916d-4b51-951e-ee1451fdad3b tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f269e146c844480c822347c3a38d103b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2b17b61b73b4e6d81dd8ffe9cf311ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:40:23.353272 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-af934d05-916d-4b51-951e-ee1451fdad3b tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] 10.222.0.42 "GET /compute/v2.1/servers/d4d7ae82-4a52-4e0e-87b5-13a5b95cc3a0" status: 200 len: 1369 microversion: 2.1 time: 0.154300 Jun 06 10:40:23.353842 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 150/278] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:40:23 2022] GET /compute/v2.1/servers/d4d7ae82-4a52-4e0e-87b5-13a5b95cc3a0 => generated 1369 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:40:24.159214 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-2072e3df-fbe8-4bb4-b53c-19fb807c178d tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:40:24.160021 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-2072e3df-fbe8-4bb4-b53c-19fb807c178d tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] [instance: f49079c1-1384-4136-b6cf-eadc40fb5aa1] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:40:24.172176 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-2072e3df-fbe8-4bb4-b53c-19fb807c178d tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:40:24.173015 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-2072e3df-fbe8-4bb4-b53c-19fb807c178d tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:40:24.173985 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-2072e3df-fbe8-4bb4-b53c-19fb807c178d tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:40:24.174481 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-2072e3df-fbe8-4bb4-b53c-19fb807c178d tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:40:24.375294 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-2072e3df-fbe8-4bb4-b53c-19fb807c178d tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b7d82c999646b6b6b96d565f0e3f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe30c756a2f84166ad23af1edf83157e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:40:24.384446 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-2072e3df-fbe8-4bb4-b53c-19fb807c178d tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] 10.222.0.42 "GET /compute/v2.1/servers/f49079c1-1384-4136-b6cf-eadc40fb5aa1" status: 200 len: 1722 microversion: 2.1 time: 0.229533 Jun 06 10:40:24.385126 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 151/279] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:40:24 2022] GET /compute/v2.1/servers/f49079c1-1384-4136-b6cf-eadc40fb5aa1 => generated 1722 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 10:40:24.391200 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-ca913063-b3cd-4ae7-bde9-0a62e10d18d2 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:40:24.392042 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-ca913063-b3cd-4ae7-bde9-0a62e10d18d2 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] [instance: d4d7ae82-4a52-4e0e-87b5-13a5b95cc3a0] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:40:24.399474 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-ca913063-b3cd-4ae7-bde9-0a62e10d18d2 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:40:24.400030 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-ca913063-b3cd-4ae7-bde9-0a62e10d18d2 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:40:24.400869 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-ca913063-b3cd-4ae7-bde9-0a62e10d18d2 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:40:24.401501 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-ca913063-b3cd-4ae7-bde9-0a62e10d18d2 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:40:24.545070 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-ca913063-b3cd-4ae7-bde9-0a62e10d18d2 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f269e146c844480c822347c3a38d103b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2b17b61b73b4e6d81dd8ffe9cf311ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:40:24.552520 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-ca913063-b3cd-4ae7-bde9-0a62e10d18d2 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] 10.222.0.42 "GET /compute/v2.1/servers/d4d7ae82-4a52-4e0e-87b5-13a5b95cc3a0" status: 200 len: 1563 microversion: 2.1 time: 0.166155 Jun 06 10:40:24.553076 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 152/280] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:40:24 2022] GET /compute/v2.1/servers/d4d7ae82-4a52-4e0e-87b5-13a5b95cc3a0 => generated 1563 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:40:24.571459 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-e99324a9-b1b4-4719-bc50-091b632b4c8d tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:40:24.572006 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-e99324a9-b1b4-4719-bc50-091b632b4c8d tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] [instance: d4d7ae82-4a52-4e0e-87b5-13a5b95cc3a0] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:40:24.577907 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-e99324a9-b1b4-4719-bc50-091b632b4c8d tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:40:24.578353 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-e99324a9-b1b4-4719-bc50-091b632b4c8d tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:40:24.579144 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-e99324a9-b1b4-4719-bc50-091b632b4c8d tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:40:24.579579 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-e99324a9-b1b4-4719-bc50-091b632b4c8d tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:40:24.661064 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-e99324a9-b1b4-4719-bc50-091b632b4c8d tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] 10.222.0.42 "GET /compute/v2.1/servers/d4d7ae82-4a52-4e0e-87b5-13a5b95cc3a0/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.093756 Jun 06 10:40:24.661653 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 153/281] 10.222.0.42 () {58 vars in 1274 bytes} [Mon Jun 6 10:40:24 2022] GET /compute/v2.1/servers/d4d7ae82-4a52-4e0e-87b5-13a5b95cc3a0/os-interface => generated 284 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 06 10:40:25.393449 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-dd2948e4-1b76-45df-8f69-fcd8f3b63021 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] 10.222.0.42 "POST /compute/v2.1/servers/5a0a79a6-8e61-477e-8269-730dfb6d04a6/action" status: 202 len: 0 microversion: 2.20 time: 9.285856 Jun 06 10:40:25.394407 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 129/282] 10.222.0.42 () {62 vars in 1318 bytes} [Mon Jun 6 10:40:16 2022] POST /compute/v2.1/servers/5a0a79a6-8e61-477e-8269-730dfb6d04a6/action => generated 0 bytes in 9288 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 06 10:40:25.404617 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-f2148759-0197-46ca-966e-8d44aa8cc135 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:40:25.405936 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-f2148759-0197-46ca-966e-8d44aa8cc135 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] [instance: f49079c1-1384-4136-b6cf-eadc40fb5aa1] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:40:25.413702 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-f2148759-0197-46ca-966e-8d44aa8cc135 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:40:25.413919 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-be136dc3-f592-4f3b-82b8-bc4d9f92bc46 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:40:25.414880 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-f2148759-0197-46ca-966e-8d44aa8cc135 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:40:25.416034 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-f2148759-0197-46ca-966e-8d44aa8cc135 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:40:25.416154 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-be136dc3-f592-4f3b-82b8-bc4d9f92bc46 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] [instance: 5a0a79a6-8e61-477e-8269-730dfb6d04a6] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:40:25.416731 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-f2148759-0197-46ca-966e-8d44aa8cc135 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:40:25.423228 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-be136dc3-f592-4f3b-82b8-bc4d9f92bc46 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:40:25.423760 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-be136dc3-f592-4f3b-82b8-bc4d9f92bc46 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:40:25.425009 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-be136dc3-f592-4f3b-82b8-bc4d9f92bc46 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:40:25.425563 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-be136dc3-f592-4f3b-82b8-bc4d9f92bc46 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:40:25.807644 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-f2148759-0197-46ca-966e-8d44aa8cc135 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b7d82c999646b6b6b96d565f0e3f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe30c756a2f84166ad23af1edf83157e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:40:25.811328 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG dbcounter [-] [129349] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 10:40:25.817113 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-f2148759-0197-46ca-966e-8d44aa8cc135 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] 10.222.0.42 "GET /compute/v2.1/servers/f49079c1-1384-4136-b6cf-eadc40fb5aa1" status: 200 len: 1722 microversion: 2.1 time: 0.417048 Jun 06 10:40:25.817824 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 154/283] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:40:25 2022] GET /compute/v2.1/servers/f49079c1-1384-4136-b6cf-eadc40fb5aa1 => generated 1722 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:40:25.819721 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-be136dc3-f592-4f3b-82b8-bc4d9f92bc46 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:40:25.834337 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-be136dc3-f592-4f3b-82b8-bc4d9f92bc46 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:40:25.835957 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-be136dc3-f592-4f3b-82b8-bc4d9f92bc46 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:40:25.837073 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-be136dc3-f592-4f3b-82b8-bc4d9f92bc46 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0a79a6-8e61-477e-8269-730dfb6d04a6" status: 200 len: 1722 microversion: 2.20 time: 0.427902 Jun 06 10:40:25.837624 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 130/284] 10.222.0.42 () {60 vars in 1276 bytes} [Mon Jun 6 10:40:25 2022] GET /compute/v2.1/servers/5a0a79a6-8e61-477e-8269-730dfb6d04a6 => generated 1722 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 10:40:26.216535 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [req-78760e9f-2a1b-4a40-bff1-c2aa7b8224ea req-48b3abfb-0d91-421b-b29b-cb7531ac8269 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d4d7ae82-4a52-4e0e-87b5-13a5b95cc3a0", "tag": "c4ec0cb9-f04f-437e-bf0f-93e81d012b38"}]} {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 10:40:26.225806 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [req-78760e9f-2a1b-4a40-bff1-c2aa7b8224ea req-48b3abfb-0d91-421b-b29b-cb7531ac8269 service nova] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:40:26.226243 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [req-78760e9f-2a1b-4a40-bff1-c2aa7b8224ea req-48b3abfb-0d91-421b-b29b-cb7531ac8269 service nova] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:40:26.237560 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.compute.server_external_events [req-78760e9f-2a1b-4a40-bff1-c2aa7b8224ea req-48b3abfb-0d91-421b-b29b-cb7531ac8269 service nova] Creating event network-changed:c4ec0cb9-f04f-437e-bf0f-93e81d012b38 for instance d4d7ae82-4a52-4e0e-87b5-13a5b95cc3a0 on hv-cinder-84482 Jun 06 10:40:26.243084 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [req-78760e9f-2a1b-4a40-bff1-c2aa7b8224ea req-48b3abfb-0d91-421b-b29b-cb7531ac8269 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030378 Jun 06 10:40:26.243718 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 155/285] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Jun 6 10:40:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 10:40:26.835661 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-14aa4dc3-8fc0-479d-b6cb-69af72db7a82 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:40:26.836333 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-14aa4dc3-8fc0-479d-b6cb-69af72db7a82 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] [instance: f49079c1-1384-4136-b6cf-eadc40fb5aa1] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:40:26.842861 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-14aa4dc3-8fc0-479d-b6cb-69af72db7a82 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:40:26.843303 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-14aa4dc3-8fc0-479d-b6cb-69af72db7a82 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:40:26.844080 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-14aa4dc3-8fc0-479d-b6cb-69af72db7a82 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:40:26.844510 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-14aa4dc3-8fc0-479d-b6cb-69af72db7a82 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:40:26.859086 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-b1bbe20b-0a50-4c10-b5bf-cb447804c2df tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:40:26.859984 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-b1bbe20b-0a50-4c10-b5bf-cb447804c2df tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] [instance: 5a0a79a6-8e61-477e-8269-730dfb6d04a6] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:40:26.866973 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-b1bbe20b-0a50-4c10-b5bf-cb447804c2df tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:40:26.868323 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-b1bbe20b-0a50-4c10-b5bf-cb447804c2df tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:40:26.869205 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-b1bbe20b-0a50-4c10-b5bf-cb447804c2df tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:40:26.869738 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-b1bbe20b-0a50-4c10-b5bf-cb447804c2df tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:40:27.075833 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-14aa4dc3-8fc0-479d-b6cb-69af72db7a82 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b7d82c999646b6b6b96d565f0e3f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe30c756a2f84166ad23af1edf83157e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:40:27.080475 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-b1bbe20b-0a50-4c10-b5bf-cb447804c2df tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:40:27.083855 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-14aa4dc3-8fc0-479d-b6cb-69af72db7a82 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] 10.222.0.42 "GET /compute/v2.1/servers/f49079c1-1384-4136-b6cf-eadc40fb5aa1" status: 200 len: 1722 microversion: 2.1 time: 0.252090 Jun 06 10:40:27.084433 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 131/286] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:40:26 2022] GET /compute/v2.1/servers/f49079c1-1384-4136-b6cf-eadc40fb5aa1 => generated 1722 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:40:27.090355 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-b1bbe20b-0a50-4c10-b5bf-cb447804c2df tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:40:27.092093 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-b1bbe20b-0a50-4c10-b5bf-cb447804c2df tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:40:27.093430 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-b1bbe20b-0a50-4c10-b5bf-cb447804c2df tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0a79a6-8e61-477e-8269-730dfb6d04a6" status: 200 len: 1722 microversion: 2.20 time: 0.239659 Jun 06 10:40:27.094185 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 156/287] 10.222.0.42 () {60 vars in 1276 bytes} [Mon Jun 6 10:40:26 2022] GET /compute/v2.1/servers/5a0a79a6-8e61-477e-8269-730dfb6d04a6 => generated 1722 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 10:40:28.100167 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-1c0cdfe8-6c88-4156-bdb6-be13a627c68c tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:40:28.100777 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-1c0cdfe8-6c88-4156-bdb6-be13a627c68c tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] [instance: f49079c1-1384-4136-b6cf-eadc40fb5aa1] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:40:28.107389 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-1c0cdfe8-6c88-4156-bdb6-be13a627c68c tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:40:28.107859 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-1c0cdfe8-6c88-4156-bdb6-be13a627c68c tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:40:28.108622 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-1c0cdfe8-6c88-4156-bdb6-be13a627c68c tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:40:28.109053 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-1c0cdfe8-6c88-4156-bdb6-be13a627c68c tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:40:28.112589 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-a3f1a979-6144-4561-888f-44e93ba42b42 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:40:28.113268 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-a3f1a979-6144-4561-888f-44e93ba42b42 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] [instance: 5a0a79a6-8e61-477e-8269-730dfb6d04a6] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:40:28.120910 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-a3f1a979-6144-4561-888f-44e93ba42b42 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:40:28.121347 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-a3f1a979-6144-4561-888f-44e93ba42b42 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:40:28.122110 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-a3f1a979-6144-4561-888f-44e93ba42b42 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:40:28.122535 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-a3f1a979-6144-4561-888f-44e93ba42b42 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:40:28.297615 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-1c0cdfe8-6c88-4156-bdb6-be13a627c68c tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b7d82c999646b6b6b96d565f0e3f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe30c756a2f84166ad23af1edf83157e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:40:28.306084 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-1c0cdfe8-6c88-4156-bdb6-be13a627c68c tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] 10.222.0.42 "GET /compute/v2.1/servers/f49079c1-1384-4136-b6cf-eadc40fb5aa1" status: 200 len: 1722 microversion: 2.1 time: 0.209621 Jun 06 10:40:28.306652 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 132/288] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:40:28 2022] GET /compute/v2.1/servers/f49079c1-1384-4136-b6cf-eadc40fb5aa1 => generated 1722 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:40:28.314278 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-a3f1a979-6144-4561-888f-44e93ba42b42 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:40:28.323439 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-a3f1a979-6144-4561-888f-44e93ba42b42 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:40:28.324951 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-a3f1a979-6144-4561-888f-44e93ba42b42 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:40:28.326115 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-a3f1a979-6144-4561-888f-44e93ba42b42 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0a79a6-8e61-477e-8269-730dfb6d04a6" status: 200 len: 1722 microversion: 2.20 time: 0.217464 Jun 06 10:40:28.326921 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 157/289] 10.222.0.42 () {60 vars in 1276 bytes} [Mon Jun 6 10:40:28 2022] GET /compute/v2.1/servers/5a0a79a6-8e61-477e-8269-730dfb6d04a6 => generated 1722 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 06 10:40:29.322900 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-6bba97d3-5341-426b-a29b-42f9ffcf4d90 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:40:29.323515 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-6bba97d3-5341-426b-a29b-42f9ffcf4d90 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] [instance: f49079c1-1384-4136-b6cf-eadc40fb5aa1] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:40:29.329890 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-6bba97d3-5341-426b-a29b-42f9ffcf4d90 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:40:29.330334 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-6bba97d3-5341-426b-a29b-42f9ffcf4d90 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:40:29.331089 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-6bba97d3-5341-426b-a29b-42f9ffcf4d90 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:40:29.331518 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-6bba97d3-5341-426b-a29b-42f9ffcf4d90 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:40:29.344125 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-25615f0c-de31-4851-81b9-20d94ab628cf tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:40:29.344781 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-25615f0c-de31-4851-81b9-20d94ab628cf tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] [instance: 5a0a79a6-8e61-477e-8269-730dfb6d04a6] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:40:29.351818 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-25615f0c-de31-4851-81b9-20d94ab628cf tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:40:29.352302 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-25615f0c-de31-4851-81b9-20d94ab628cf tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:40:29.353104 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-25615f0c-de31-4851-81b9-20d94ab628cf tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:40:29.353608 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-25615f0c-de31-4851-81b9-20d94ab628cf tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:40:29.522849 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-6bba97d3-5341-426b-a29b-42f9ffcf4d90 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b7d82c999646b6b6b96d565f0e3f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe30c756a2f84166ad23af1edf83157e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:40:29.532391 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-6bba97d3-5341-426b-a29b-42f9ffcf4d90 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] 10.222.0.42 "GET /compute/v2.1/servers/f49079c1-1384-4136-b6cf-eadc40fb5aa1" status: 200 len: 1722 microversion: 2.1 time: 0.213771 Jun 06 10:40:29.542188 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 133/290] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:40:29 2022] GET /compute/v2.1/servers/f49079c1-1384-4136-b6cf-eadc40fb5aa1 => generated 1722 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:40:29.546538 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-25615f0c-de31-4851-81b9-20d94ab628cf tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:40:29.556418 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-25615f0c-de31-4851-81b9-20d94ab628cf tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:40:29.557962 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-25615f0c-de31-4851-81b9-20d94ab628cf tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:40:29.559485 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-25615f0c-de31-4851-81b9-20d94ab628cf tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0a79a6-8e61-477e-8269-730dfb6d04a6" status: 200 len: 1722 microversion: 2.20 time: 0.219379 Jun 06 10:40:29.560081 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 158/291] 10.222.0.42 () {60 vars in 1276 bytes} [Mon Jun 6 10:40:29 2022] GET /compute/v2.1/servers/5a0a79a6-8e61-477e-8269-730dfb6d04a6 => generated 1722 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 06 10:40:30.549605 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-f247f380-590c-4133-ba43-7d4b46cbe5c2 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:40:30.550271 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-f247f380-590c-4133-ba43-7d4b46cbe5c2 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] [instance: f49079c1-1384-4136-b6cf-eadc40fb5aa1] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:40:30.556773 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-f247f380-590c-4133-ba43-7d4b46cbe5c2 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:40:30.557219 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-f247f380-590c-4133-ba43-7d4b46cbe5c2 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:40:30.558010 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-f247f380-590c-4133-ba43-7d4b46cbe5c2 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:40:30.558487 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-f247f380-590c-4133-ba43-7d4b46cbe5c2 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:40:30.580561 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-3495a04d-56b4-4d87-af6e-04ea81302185 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:40:30.581374 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-3495a04d-56b4-4d87-af6e-04ea81302185 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] [instance: 5a0a79a6-8e61-477e-8269-730dfb6d04a6] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:40:30.595730 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-3495a04d-56b4-4d87-af6e-04ea81302185 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:40:30.596390 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-3495a04d-56b4-4d87-af6e-04ea81302185 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:40:30.597263 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-3495a04d-56b4-4d87-af6e-04ea81302185 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:40:30.600296 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-3495a04d-56b4-4d87-af6e-04ea81302185 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:40:30.822003 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-f247f380-590c-4133-ba43-7d4b46cbe5c2 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b7d82c999646b6b6b96d565f0e3f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe30c756a2f84166ad23af1edf83157e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:40:30.825528 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-3495a04d-56b4-4d87-af6e-04ea81302185 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:40:30.830514 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-f247f380-590c-4133-ba43-7d4b46cbe5c2 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] 10.222.0.42 "GET /compute/v2.1/servers/f49079c1-1384-4136-b6cf-eadc40fb5aa1" status: 200 len: 1722 microversion: 2.1 time: 0.284672 Jun 06 10:40:30.832587 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 134/292] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:40:30 2022] GET /compute/v2.1/servers/f49079c1-1384-4136-b6cf-eadc40fb5aa1 => generated 1722 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 10:40:30.842261 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-3495a04d-56b4-4d87-af6e-04ea81302185 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:40:30.842261 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-3495a04d-56b4-4d87-af6e-04ea81302185 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:40:30.842261 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-3495a04d-56b4-4d87-af6e-04ea81302185 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0a79a6-8e61-477e-8269-730dfb6d04a6" status: 200 len: 1722 microversion: 2.20 time: 0.261585 Jun 06 10:40:30.842838 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 159/293] 10.222.0.42 () {60 vars in 1276 bytes} [Mon Jun 6 10:40:30 2022] GET /compute/v2.1/servers/5a0a79a6-8e61-477e-8269-730dfb6d04a6 => generated 1722 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 06 10:40:31.852047 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-2d50a9f4-ecdb-40cf-b494-87a0644598f3 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:40:31.857701 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-847290ed-a448-4961-9737-1436bef233df tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:40:31.858306 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-847290ed-a448-4961-9737-1436bef233df tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] [instance: 5a0a79a6-8e61-477e-8269-730dfb6d04a6] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:40:31.861733 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-2d50a9f4-ecdb-40cf-b494-87a0644598f3 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] [instance: f49079c1-1384-4136-b6cf-eadc40fb5aa1] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:40:31.869651 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-847290ed-a448-4961-9737-1436bef233df tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:40:31.870123 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-847290ed-a448-4961-9737-1436bef233df tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:40:31.870861 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-847290ed-a448-4961-9737-1436bef233df tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:40:31.871288 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-847290ed-a448-4961-9737-1436bef233df tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:40:31.872982 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-2d50a9f4-ecdb-40cf-b494-87a0644598f3 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:40:31.873421 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-2d50a9f4-ecdb-40cf-b494-87a0644598f3 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:40:31.874188 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-2d50a9f4-ecdb-40cf-b494-87a0644598f3 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:40:31.874619 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-2d50a9f4-ecdb-40cf-b494-87a0644598f3 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:40:32.105600 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-847290ed-a448-4961-9737-1436bef233df tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:40:32.108770 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-2d50a9f4-ecdb-40cf-b494-87a0644598f3 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b7d82c999646b6b6b96d565f0e3f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe30c756a2f84166ad23af1edf83157e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:40:32.115428 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-847290ed-a448-4961-9737-1436bef233df tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:40:32.116969 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-847290ed-a448-4961-9737-1436bef233df tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:40:32.117105 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-2d50a9f4-ecdb-40cf-b494-87a0644598f3 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] 10.222.0.42 "GET /compute/v2.1/servers/f49079c1-1384-4136-b6cf-eadc40fb5aa1" status: 200 len: 1722 microversion: 2.1 time: 0.270574 Jun 06 10:40:32.117646 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 160/294] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:40:31 2022] GET /compute/v2.1/servers/f49079c1-1384-4136-b6cf-eadc40fb5aa1 => generated 1722 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:40:32.119606 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-847290ed-a448-4961-9737-1436bef233df tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0a79a6-8e61-477e-8269-730dfb6d04a6" status: 200 len: 1722 microversion: 2.20 time: 0.265729 Jun 06 10:40:32.120336 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 135/295] 10.222.0.42 () {60 vars in 1276 bytes} [Mon Jun 6 10:40:31 2022] GET /compute/v2.1/servers/5a0a79a6-8e61-477e-8269-730dfb6d04a6 => generated 1722 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 10:40:33.138899 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-50f13227-7430-4215-83ef-862ab58d9574 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:40:33.138899 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-50f13227-7430-4215-83ef-862ab58d9574 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] [instance: f49079c1-1384-4136-b6cf-eadc40fb5aa1] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:40:33.146123 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-50f13227-7430-4215-83ef-862ab58d9574 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:40:33.146568 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-50f13227-7430-4215-83ef-862ab58d9574 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:40:33.148129 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-50f13227-7430-4215-83ef-862ab58d9574 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:40:33.148883 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-18e9c8b7-09c7-4e83-9c6b-f83825323488 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:40:33.149371 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-50f13227-7430-4215-83ef-862ab58d9574 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:40:33.150822 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-18e9c8b7-09c7-4e83-9c6b-f83825323488 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] [instance: 5a0a79a6-8e61-477e-8269-730dfb6d04a6] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:40:33.158598 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-18e9c8b7-09c7-4e83-9c6b-f83825323488 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:40:33.159355 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-18e9c8b7-09c7-4e83-9c6b-f83825323488 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:40:33.160877 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-18e9c8b7-09c7-4e83-9c6b-f83825323488 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:40:33.161488 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-18e9c8b7-09c7-4e83-9c6b-f83825323488 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:40:33.385722 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-18e9c8b7-09c7-4e83-9c6b-f83825323488 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:40:33.403273 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-18e9c8b7-09c7-4e83-9c6b-f83825323488 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:40:33.404820 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-18e9c8b7-09c7-4e83-9c6b-f83825323488 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:40:33.407265 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-18e9c8b7-09c7-4e83-9c6b-f83825323488 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0a79a6-8e61-477e-8269-730dfb6d04a6" status: 200 len: 1722 microversion: 2.20 time: 0.266456 Jun 06 10:40:33.410693 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 136/296] 10.222.0.42 () {60 vars in 1276 bytes} [Mon Jun 6 10:40:33 2022] GET /compute/v2.1/servers/5a0a79a6-8e61-477e-8269-730dfb6d04a6 => generated 1722 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 06 10:40:33.435149 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-50f13227-7430-4215-83ef-862ab58d9574 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b7d82c999646b6b6b96d565f0e3f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe30c756a2f84166ad23af1edf83157e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:40:33.444334 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-50f13227-7430-4215-83ef-862ab58d9574 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] 10.222.0.42 "GET /compute/v2.1/servers/f49079c1-1384-4136-b6cf-eadc40fb5aa1" status: 200 len: 1722 microversion: 2.1 time: 0.314388 Jun 06 10:40:33.445291 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 161/297] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:40:33 2022] GET /compute/v2.1/servers/f49079c1-1384-4136-b6cf-eadc40fb5aa1 => generated 1722 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:40:34.432336 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-edef4a03-b587-40c5-a9a2-57e91d8867e4 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:40:34.433042 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-edef4a03-b587-40c5-a9a2-57e91d8867e4 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] [instance: 5a0a79a6-8e61-477e-8269-730dfb6d04a6] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:40:34.440918 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-edef4a03-b587-40c5-a9a2-57e91d8867e4 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:40:34.443299 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-6f4c48c8-a17f-4e32-bd69-601f5635d9d6 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1130724437", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1759320847", "security_groups": [{"name": "tempest-secgroup-smoke-923763746"}], "networks": [{"uuid": "f79f1560-64fa-4050-91ae-b1a386d5c477"}], "block_device_mapping_v2": [{"uuid": "9faa1b03-75c7-4942-be7d-df072bc70078", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 10:40:34.444261 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-edef4a03-b587-40c5-a9a2-57e91d8867e4 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:40:34.445912 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-edef4a03-b587-40c5-a9a2-57e91d8867e4 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:40:34.447734 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-edef4a03-b587-40c5-a9a2-57e91d8867e4 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:40:34.458573 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG dbcounter [-] [129349] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=129349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 10:40:34.699923 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.network.neutron [None req-6f4c48c8-a17f-4e32-bd69-601f5635d9d6 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] validate_networks() for [('f79f1560-64fa-4050-91ae-b1a386d5c477', None, None, None, None, None)] {{(pid=129349) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 06 10:40:34.728430 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-edef4a03-b587-40c5-a9a2-57e91d8867e4 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:40:34.741178 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-edef4a03-b587-40c5-a9a2-57e91d8867e4 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:40:34.743867 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-edef4a03-b587-40c5-a9a2-57e91d8867e4 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:40:34.745280 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-edef4a03-b587-40c5-a9a2-57e91d8867e4 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0a79a6-8e61-477e-8269-730dfb6d04a6" status: 200 len: 1722 microversion: 2.20 time: 0.317662 Jun 06 10:40:34.745844 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 137/298] 10.222.0.42 () {60 vars in 1276 bytes} [Mon Jun 6 10:40:34 2022] GET /compute/v2.1/servers/5a0a79a6-8e61-477e-8269-730dfb6d04a6 => generated 1722 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 10:40:34.752111 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-0524f114-0d12-4817-9481-17beed2c1ef1 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:40:34.753300 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-0524f114-0d12-4817-9481-17beed2c1ef1 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] [instance: f49079c1-1384-4136-b6cf-eadc40fb5aa1] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:40:34.761522 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG dbcounter [-] [129350] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=3 {{(pid=129350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 10:40:34.764993 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-0524f114-0d12-4817-9481-17beed2c1ef1 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:40:34.765959 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-0524f114-0d12-4817-9481-17beed2c1ef1 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:40:34.767027 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-0524f114-0d12-4817-9481-17beed2c1ef1 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:40:34.767669 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-0524f114-0d12-4817-9481-17beed2c1ef1 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:40:35.088729 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-0524f114-0d12-4817-9481-17beed2c1ef1 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b7d82c999646b6b6b96d565f0e3f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe30c756a2f84166ad23af1edf83157e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:40:35.099944 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-0524f114-0d12-4817-9481-17beed2c1ef1 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] 10.222.0.42 "GET /compute/v2.1/servers/f49079c1-1384-4136-b6cf-eadc40fb5aa1" status: 200 len: 1722 microversion: 2.1 time: 0.352864 Jun 06 10:40:35.112366 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 138/299] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:40:34 2022] GET /compute/v2.1/servers/f49079c1-1384-4136-b6cf-eadc40fb5aa1 => generated 1722 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:40:35.375622 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.virt.hardware [None req-6f4c48c8-a17f-4e32-bd69-601f5635d9d6 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Flavor limits 0:0:0 {{(pid=129349) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 06 10:40:35.376231 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.virt.hardware [None req-6f4c48c8-a17f-4e32-bd69-601f5635d9d6 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Image limits 0:0:0 {{(pid=129349) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 06 10:40:35.377001 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.virt.hardware [None req-6f4c48c8-a17f-4e32-bd69-601f5635d9d6 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Flavor pref 0:0:0 {{(pid=129349) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 06 10:40:35.377667 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.virt.hardware [None req-6f4c48c8-a17f-4e32-bd69-601f5635d9d6 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Image pref 0:0:0 {{(pid=129349) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 06 10:40:35.378336 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.virt.hardware [None req-6f4c48c8-a17f-4e32-bd69-601f5635d9d6 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129349) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 06 10:40:35.391860 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-6f4c48c8-a17f-4e32-bd69-601f5635d9d6 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:40:35.393627 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-6f4c48c8-a17f-4e32-bd69-601f5635d9d6 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:40:35.394375 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-6f4c48c8-a17f-4e32-bd69-601f5635d9d6 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:40:35.395041 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-6f4c48c8-a17f-4e32-bd69-601f5635d9d6 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:40:35.417202 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.quota [None req-6f4c48c8-a17f-4e32-bd69-601f5635d9d6 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Getting quotas for project ef2496096b374f399606bff9a08b65eb. Resources: {'ram', 'cores', 'instances'} {{(pid=129349) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 06 10:40:35.422487 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.quota [None req-6f4c48c8-a17f-4e32-bd69-601f5635d9d6 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Getting quotas for user 6d09fe912b4c4cab81b00df801f69680 and project ef2496096b374f399606bff9a08b65eb. Resources: {'ram', 'cores', 'instances'} {{(pid=129349) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 06 10:40:35.506560 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-6f4c48c8-a17f-4e32-bd69-601f5635d9d6 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Going to run 1 instances... {{(pid=129349) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 06 10:40:35.510161 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-6f4c48c8-a17f-4e32-bd69-601f5635d9d6 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] [instance: f835921f-5523-4063-89d9-1fe690669fb9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='9faa1b03-75c7-4942-be7d-df072bc70078',volume_size=None,volume_type=None)] {{(pid=129349) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 06 10:40:35.815852 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-c94b845a-a3eb-4ddb-a3a9-146925e6ee18 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:40:35.817728 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-c94b845a-a3eb-4ddb-a3a9-146925e6ee18 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] [instance: 5a0a79a6-8e61-477e-8269-730dfb6d04a6] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:40:35.826749 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-c94b845a-a3eb-4ddb-a3a9-146925e6ee18 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:40:35.833782 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-c94b845a-a3eb-4ddb-a3a9-146925e6ee18 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:40:35.841819 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-6f4c48c8-a17f-4e32-bd69-601f5635d9d6 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.402248 Jun 06 10:40:35.848255 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 162/300] 10.222.0.42 () {60 vars in 1146 bytes} [Mon Jun 6 10:40:34 2022] POST /compute/v2.1/servers => generated 405 bytes in 1409 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 06 10:40:35.854371 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-79e23f0b-7f7d-4963-82ae-db2c62d942c2 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:40:35.854951 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-c94b845a-a3eb-4ddb-a3a9-146925e6ee18 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:40:35.855976 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-79e23f0b-7f7d-4963-82ae-db2c62d942c2 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] [instance: f835921f-5523-4063-89d9-1fe690669fb9] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:40:35.858651 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-c94b845a-a3eb-4ddb-a3a9-146925e6ee18 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:40:35.999274 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-79e23f0b-7f7d-4963-82ae-db2c62d942c2 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d09fe912b4c4cab81b00df801f69680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2496096b374f399606bff9a08b65eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:40:36.007150 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-79e23f0b-7f7d-4963-82ae-db2c62d942c2 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] 10.222.0.42 "GET /compute/v2.1/servers/f835921f-5523-4063-89d9-1fe690669fb9" status: 200 len: 1089 microversion: 2.1 time: 0.157432 Jun 06 10:40:36.008217 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 163/301] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:40:35 2022] GET /compute/v2.1/servers/f835921f-5523-4063-89d9-1fe690669fb9 => generated 1089 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:40:36.106192 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-c94b845a-a3eb-4ddb-a3a9-146925e6ee18 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:40:36.122604 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-28d96088-0af2-4c54-bc7f-27adf04a458e tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:40:36.123224 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-28d96088-0af2-4c54-bc7f-27adf04a458e tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] [instance: f49079c1-1384-4136-b6cf-eadc40fb5aa1] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:40:36.139106 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-c94b845a-a3eb-4ddb-a3a9-146925e6ee18 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:40:36.142433 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-28d96088-0af2-4c54-bc7f-27adf04a458e tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:40:36.144785 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-c94b845a-a3eb-4ddb-a3a9-146925e6ee18 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:40:36.145359 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-28d96088-0af2-4c54-bc7f-27adf04a458e tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:40:36.147405 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-c94b845a-a3eb-4ddb-a3a9-146925e6ee18 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0a79a6-8e61-477e-8269-730dfb6d04a6" status: 200 len: 1722 microversion: 2.20 time: 0.337756 Jun 06 10:40:36.148157 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-28d96088-0af2-4c54-bc7f-27adf04a458e tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:40:36.149509 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-28d96088-0af2-4c54-bc7f-27adf04a458e tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:40:36.151657 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 139/302] 10.222.0.42 () {60 vars in 1276 bytes} [Mon Jun 6 10:40:35 2022] GET /compute/v2.1/servers/5a0a79a6-8e61-477e-8269-730dfb6d04a6 => generated 1722 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 10:40:36.420519 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-28d96088-0af2-4c54-bc7f-27adf04a458e tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b7d82c999646b6b6b96d565f0e3f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe30c756a2f84166ad23af1edf83157e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:40:36.430389 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-28d96088-0af2-4c54-bc7f-27adf04a458e tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] 10.222.0.42 "GET /compute/v2.1/servers/f49079c1-1384-4136-b6cf-eadc40fb5aa1" status: 200 len: 1722 microversion: 2.1 time: 0.315776 Jun 06 10:40:36.432316 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 164/303] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:40:36 2022] GET /compute/v2.1/servers/f49079c1-1384-4136-b6cf-eadc40fb5aa1 => generated 1722 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:40:37.026422 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-f42c0f73-fed3-4f2d-8f44-b74af32ebd06 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:40:37.027759 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-f42c0f73-fed3-4f2d-8f44-b74af32ebd06 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] [instance: f835921f-5523-4063-89d9-1fe690669fb9] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:40:37.035371 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-f42c0f73-fed3-4f2d-8f44-b74af32ebd06 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:40:37.036375 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-f42c0f73-fed3-4f2d-8f44-b74af32ebd06 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:40:37.037467 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-f42c0f73-fed3-4f2d-8f44-b74af32ebd06 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:40:37.038111 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-f42c0f73-fed3-4f2d-8f44-b74af32ebd06 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:40:37.128860 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-f42c0f73-fed3-4f2d-8f44-b74af32ebd06 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d09fe912b4c4cab81b00df801f69680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2496096b374f399606bff9a08b65eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:40:37.137695 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-f42c0f73-fed3-4f2d-8f44-b74af32ebd06 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] 10.222.0.42 "GET /compute/v2.1/servers/f835921f-5523-4063-89d9-1fe690669fb9" status: 200 len: 1187 microversion: 2.1 time: 0.116091 Jun 06 10:40:37.138452 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 140/304] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:40:37 2022] GET /compute/v2.1/servers/f835921f-5523-4063-89d9-1fe690669fb9 => generated 1187 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:40:37.169322 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-fb298c48-0714-484a-b021-973d812af787 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:40:37.170661 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-fb298c48-0714-484a-b021-973d812af787 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] [instance: 5a0a79a6-8e61-477e-8269-730dfb6d04a6] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:40:37.183205 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-fb298c48-0714-484a-b021-973d812af787 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:40:37.183746 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-fb298c48-0714-484a-b021-973d812af787 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:40:37.184637 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-fb298c48-0714-484a-b021-973d812af787 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:40:37.185374 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-fb298c48-0714-484a-b021-973d812af787 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:40:37.451306 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-c514c2fc-e225-4282-8c15-4a7845e7d3f3 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:40:37.451933 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-c514c2fc-e225-4282-8c15-4a7845e7d3f3 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] [instance: f49079c1-1384-4136-b6cf-eadc40fb5aa1] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:40:37.459946 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-c514c2fc-e225-4282-8c15-4a7845e7d3f3 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:40:37.462870 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-c514c2fc-e225-4282-8c15-4a7845e7d3f3 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:40:37.464661 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-c514c2fc-e225-4282-8c15-4a7845e7d3f3 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:40:37.465294 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-c514c2fc-e225-4282-8c15-4a7845e7d3f3 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:40:37.932693 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-fb298c48-0714-484a-b021-973d812af787 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:40:37.948595 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-fb298c48-0714-484a-b021-973d812af787 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:40:37.953389 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-fb298c48-0714-484a-b021-973d812af787 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:40:37.953389 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-fb298c48-0714-484a-b021-973d812af787 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0a79a6-8e61-477e-8269-730dfb6d04a6" status: 200 len: 1722 microversion: 2.20 time: 0.786122 Jun 06 10:40:37.956742 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 165/305] 10.222.0.42 () {60 vars in 1276 bytes} [Mon Jun 6 10:40:37 2022] GET /compute/v2.1/servers/5a0a79a6-8e61-477e-8269-730dfb6d04a6 => generated 1722 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 06 10:40:38.044587 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-c514c2fc-e225-4282-8c15-4a7845e7d3f3 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b7d82c999646b6b6b96d565f0e3f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe30c756a2f84166ad23af1edf83157e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:40:38.076391 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-c514c2fc-e225-4282-8c15-4a7845e7d3f3 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] 10.222.0.42 "GET /compute/v2.1/servers/f49079c1-1384-4136-b6cf-eadc40fb5aa1" status: 200 len: 1722 microversion: 2.1 time: 0.628131 Jun 06 10:40:38.079224 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 141/306] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:40:37 2022] GET /compute/v2.1/servers/f49079c1-1384-4136-b6cf-eadc40fb5aa1 => generated 1722 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:40:38.157834 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-e7616f73-0387-4fdf-8b22-a0685039c452 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:40:38.158447 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-e7616f73-0387-4fdf-8b22-a0685039c452 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] [instance: f835921f-5523-4063-89d9-1fe690669fb9] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:40:38.171094 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-e7616f73-0387-4fdf-8b22-a0685039c452 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:40:38.188966 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-e7616f73-0387-4fdf-8b22-a0685039c452 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:40:38.190066 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-e7616f73-0387-4fdf-8b22-a0685039c452 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:40:38.190521 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-e7616f73-0387-4fdf-8b22-a0685039c452 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:40:38.337357 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-e7616f73-0387-4fdf-8b22-a0685039c452 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d09fe912b4c4cab81b00df801f69680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2496096b374f399606bff9a08b65eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:40:38.358763 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-e7616f73-0387-4fdf-8b22-a0685039c452 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] 10.222.0.42 "GET /compute/v2.1/servers/f835921f-5523-4063-89d9-1fe690669fb9" status: 200 len: 1205 microversion: 2.1 time: 0.197484 Jun 06 10:40:38.364230 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 166/307] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:40:38 2022] GET /compute/v2.1/servers/f835921f-5523-4063-89d9-1fe690669fb9 => generated 1205 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:40:38.974552 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-b4c2e722-f1e8-415d-8b74-5b4f2c0ebe41 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:40:38.975421 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-b4c2e722-f1e8-415d-8b74-5b4f2c0ebe41 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] [instance: 5a0a79a6-8e61-477e-8269-730dfb6d04a6] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:40:38.982348 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-b4c2e722-f1e8-415d-8b74-5b4f2c0ebe41 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:40:38.986543 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-b4c2e722-f1e8-415d-8b74-5b4f2c0ebe41 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:40:38.988728 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-b4c2e722-f1e8-415d-8b74-5b4f2c0ebe41 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:40:38.990388 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-b4c2e722-f1e8-415d-8b74-5b4f2c0ebe41 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:40:39.096345 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-ce58698c-489c-4c29-8638-44b57da62a4a tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:40:39.096955 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-ce58698c-489c-4c29-8638-44b57da62a4a tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] [instance: f49079c1-1384-4136-b6cf-eadc40fb5aa1] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:40:39.117954 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-ce58698c-489c-4c29-8638-44b57da62a4a tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:40:39.118894 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-ce58698c-489c-4c29-8638-44b57da62a4a tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:40:39.119971 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-ce58698c-489c-4c29-8638-44b57da62a4a tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:40:39.120568 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-ce58698c-489c-4c29-8638-44b57da62a4a tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:40:39.554775 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-b4c2e722-f1e8-415d-8b74-5b4f2c0ebe41 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:40:39.568603 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-b4c2e722-f1e8-415d-8b74-5b4f2c0ebe41 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:40:39.571271 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-b4c2e722-f1e8-415d-8b74-5b4f2c0ebe41 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:40:39.572526 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-b4c2e722-f1e8-415d-8b74-5b4f2c0ebe41 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0a79a6-8e61-477e-8269-730dfb6d04a6" status: 200 len: 1722 microversion: 2.20 time: 0.602593 Jun 06 10:40:39.573161 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 142/308] 10.222.0.42 () {60 vars in 1276 bytes} [Mon Jun 6 10:40:38 2022] GET /compute/v2.1/servers/5a0a79a6-8e61-477e-8269-730dfb6d04a6 => generated 1722 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 10:40:39.578712 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-951c00d4-b195-4d43-abc1-85b89f56229a tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:40:39.579322 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-951c00d4-b195-4d43-abc1-85b89f56229a tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] [instance: f835921f-5523-4063-89d9-1fe690669fb9] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:40:39.585519 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-951c00d4-b195-4d43-abc1-85b89f56229a tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:40:39.586104 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-951c00d4-b195-4d43-abc1-85b89f56229a tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:40:39.586876 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-951c00d4-b195-4d43-abc1-85b89f56229a tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:40:39.587322 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-951c00d4-b195-4d43-abc1-85b89f56229a tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:40:39.610841 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-ce58698c-489c-4c29-8638-44b57da62a4a tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b7d82c999646b6b6b96d565f0e3f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe30c756a2f84166ad23af1edf83157e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:40:39.619699 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-ce58698c-489c-4c29-8638-44b57da62a4a tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] 10.222.0.42 "GET /compute/v2.1/servers/f49079c1-1384-4136-b6cf-eadc40fb5aa1" status: 200 len: 1699 microversion: 2.1 time: 0.527091 Jun 06 10:40:39.620347 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 167/309] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:40:39 2022] GET /compute/v2.1/servers/f49079c1-1384-4136-b6cf-eadc40fb5aa1 => generated 1699 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 10:40:39.636484 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-987a9d4a-9e85-4f20-ac4d-87af77ee1021 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 10:40:39.643036 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-987a9d4a-9e85-4f20-ac4d-87af77ee1021 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:40:39.643512 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-987a9d4a-9e85-4f20-ac4d-87af77ee1021 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:40:39.667999 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-987a9d4a-9e85-4f20-ac4d-87af77ee1021 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] [instance: f49079c1-1384-4136-b6cf-eadc40fb5aa1] Going to try to start instance {{(pid=129349) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 06 10:40:39.713196 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-987a9d4a-9e85-4f20-ac4d-87af77ee1021 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] 10.222.0.42 "POST /compute/v2.1/servers/f49079c1-1384-4136-b6cf-eadc40fb5aa1/action" status: 202 len: 0 microversion: 2.1 time: 0.080440 Jun 06 10:40:39.713986 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 168/310] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Jun 6 10:40:39 2022] POST /compute/v2.1/servers/f49079c1-1384-4136-b6cf-eadc40fb5aa1/action => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 06 10:40:39.724035 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-5834d870-c86f-4453-9ef4-2a3003ad3013 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:40:39.724769 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-5834d870-c86f-4453-9ef4-2a3003ad3013 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] [instance: f49079c1-1384-4136-b6cf-eadc40fb5aa1] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:40:39.732637 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-5834d870-c86f-4453-9ef4-2a3003ad3013 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:40:39.733080 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-5834d870-c86f-4453-9ef4-2a3003ad3013 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:40:39.733962 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-5834d870-c86f-4453-9ef4-2a3003ad3013 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:40:39.734526 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-5834d870-c86f-4453-9ef4-2a3003ad3013 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:40:39.946911 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-951c00d4-b195-4d43-abc1-85b89f56229a tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d09fe912b4c4cab81b00df801f69680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2496096b374f399606bff9a08b65eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:40:39.960812 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-951c00d4-b195-4d43-abc1-85b89f56229a tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] 10.222.0.42 "GET /compute/v2.1/servers/f835921f-5523-4063-89d9-1fe690669fb9" status: 200 len: 1260 microversion: 2.1 time: 0.386144 Jun 06 10:40:39.963245 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 143/311] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:40:39 2022] GET /compute/v2.1/servers/f835921f-5523-4063-89d9-1fe690669fb9 => generated 1260 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:40:40.232380 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-5834d870-c86f-4453-9ef4-2a3003ad3013 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b7d82c999646b6b6b96d565f0e3f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe30c756a2f84166ad23af1edf83157e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:40:40.241933 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-5834d870-c86f-4453-9ef4-2a3003ad3013 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] 10.222.0.42 "GET /compute/v2.1/servers/f49079c1-1384-4136-b6cf-eadc40fb5aa1" status: 200 len: 1708 microversion: 2.1 time: 0.522831 Jun 06 10:40:40.242500 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 169/312] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:40:39 2022] GET /compute/v2.1/servers/f49079c1-1384-4136-b6cf-eadc40fb5aa1 => generated 1708 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 10:40:40.541260 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [req-66397a12-b0f7-43d1-81da-fc14b08a318d req-f1b783e2-ca80-4b73-a369-f8228bf0531e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f835921f-5523-4063-89d9-1fe690669fb9", "tag": "3a3a5f7d-eb2a-4a67-83a6-a0deab7b7e1a"}]} {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 10:40:40.561240 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [req-66397a12-b0f7-43d1-81da-fc14b08a318d req-f1b783e2-ca80-4b73-a369-f8228bf0531e service nova] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:40:40.566046 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [req-66397a12-b0f7-43d1-81da-fc14b08a318d req-f1b783e2-ca80-4b73-a369-f8228bf0531e service nova] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:40:40.590820 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-eb791691-bcf8-4944-9a94-2675ef0465a8 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:40:40.591772 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-eb791691-bcf8-4944-9a94-2675ef0465a8 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] [instance: 5a0a79a6-8e61-477e-8269-730dfb6d04a6] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:40:40.599309 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-eb791691-bcf8-4944-9a94-2675ef0465a8 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:40:40.599760 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-eb791691-bcf8-4944-9a94-2675ef0465a8 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:40:40.605720 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-eb791691-bcf8-4944-9a94-2675ef0465a8 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:40:40.606210 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-eb791691-bcf8-4944-9a94-2675ef0465a8 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:40:40.612246 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.compute.server_external_events [req-66397a12-b0f7-43d1-81da-fc14b08a318d req-f1b783e2-ca80-4b73-a369-f8228bf0531e service nova] Creating event network-changed:3a3a5f7d-eb2a-4a67-83a6-a0deab7b7e1a for instance f835921f-5523-4063-89d9-1fe690669fb9 on hv-cinder-84482 Jun 06 10:40:40.620138 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [req-66397a12-b0f7-43d1-81da-fc14b08a318d req-f1b783e2-ca80-4b73-a369-f8228bf0531e service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085923 Jun 06 10:40:40.621071 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 144/313] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Jun 6 10:40:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 10:40:40.985458 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-2812a8c9-2877-433d-8d42-18a252646c42 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:40:40.986619 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-2812a8c9-2877-433d-8d42-18a252646c42 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] [instance: f835921f-5523-4063-89d9-1fe690669fb9] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:40:40.993851 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-2812a8c9-2877-433d-8d42-18a252646c42 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:40:40.994305 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-2812a8c9-2877-433d-8d42-18a252646c42 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:40:40.995112 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-2812a8c9-2877-433d-8d42-18a252646c42 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:40:40.995542 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-2812a8c9-2877-433d-8d42-18a252646c42 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:40:41.007021 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-eb791691-bcf8-4944-9a94-2675ef0465a8 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:40:41.027132 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-eb791691-bcf8-4944-9a94-2675ef0465a8 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:40:41.029141 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-eb791691-bcf8-4944-9a94-2675ef0465a8 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:40:41.030617 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-eb791691-bcf8-4944-9a94-2675ef0465a8 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0a79a6-8e61-477e-8269-730dfb6d04a6" status: 200 len: 1722 microversion: 2.20 time: 0.443798 Jun 06 10:40:41.031733 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 170/314] 10.222.0.42 () {60 vars in 1276 bytes} [Mon Jun 6 10:40:40 2022] GET /compute/v2.1/servers/5a0a79a6-8e61-477e-8269-730dfb6d04a6 => generated 1722 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 10:40:41.259940 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-2d7e82ef-49aa-480a-b769-eb89f9afa833 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:40:41.260453 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-2d7e82ef-49aa-480a-b769-eb89f9afa833 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] [instance: f49079c1-1384-4136-b6cf-eadc40fb5aa1] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:40:41.267620 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-2d7e82ef-49aa-480a-b769-eb89f9afa833 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:40:41.268059 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-2d7e82ef-49aa-480a-b769-eb89f9afa833 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:40:41.269347 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-2d7e82ef-49aa-480a-b769-eb89f9afa833 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:40:41.269780 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-2d7e82ef-49aa-480a-b769-eb89f9afa833 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:40:41.427446 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-2812a8c9-2877-433d-8d42-18a252646c42 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d09fe912b4c4cab81b00df801f69680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2496096b374f399606bff9a08b65eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:40:41.441691 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-2812a8c9-2877-433d-8d42-18a252646c42 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] 10.222.0.42 "GET /compute/v2.1/servers/f835921f-5523-4063-89d9-1fe690669fb9" status: 200 len: 1260 microversion: 2.1 time: 0.460606 Jun 06 10:40:41.447868 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 145/315] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:40:40 2022] GET /compute/v2.1/servers/f835921f-5523-4063-89d9-1fe690669fb9 => generated 1260 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:40:41.597975 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-2d7e82ef-49aa-480a-b769-eb89f9afa833 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b7d82c999646b6b6b96d565f0e3f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe30c756a2f84166ad23af1edf83157e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:40:41.607183 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-2d7e82ef-49aa-480a-b769-eb89f9afa833 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] 10.222.0.42 "GET /compute/v2.1/servers/f49079c1-1384-4136-b6cf-eadc40fb5aa1" status: 200 len: 1708 microversion: 2.1 time: 0.351687 Jun 06 10:40:41.607870 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 171/316] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:40:41 2022] GET /compute/v2.1/servers/f49079c1-1384-4136-b6cf-eadc40fb5aa1 => generated 1708 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:40:42.050827 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-e4f40b5a-f412-443d-be13-6022074746af tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:40:42.051417 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-e4f40b5a-f412-443d-be13-6022074746af tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] [instance: 5a0a79a6-8e61-477e-8269-730dfb6d04a6] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:40:42.058025 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-e4f40b5a-f412-443d-be13-6022074746af tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:40:42.058473 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-e4f40b5a-f412-443d-be13-6022074746af tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:40:42.059242 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-e4f40b5a-f412-443d-be13-6022074746af tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:40:42.059677 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-e4f40b5a-f412-443d-be13-6022074746af tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:40:42.075547 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG dbcounter [-] [129350] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=129350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 10:40:42.214852 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-e4f40b5a-f412-443d-be13-6022074746af tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:40:42.228887 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-e4f40b5a-f412-443d-be13-6022074746af tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:40:42.231232 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-e4f40b5a-f412-443d-be13-6022074746af tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:40:42.233082 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-e4f40b5a-f412-443d-be13-6022074746af tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0a79a6-8e61-477e-8269-730dfb6d04a6" status: 200 len: 1743 microversion: 2.20 time: 0.186063 Jun 06 10:40:42.233999 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 146/317] 10.222.0.42 () {60 vars in 1276 bytes} [Mon Jun 6 10:40:42 2022] GET /compute/v2.1/servers/5a0a79a6-8e61-477e-8269-730dfb6d04a6 => generated 1743 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 10:40:42.459694 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-9bbdb05d-db1e-41ff-af63-9e11507b43d7 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:40:42.461392 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-9bbdb05d-db1e-41ff-af63-9e11507b43d7 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] [instance: f835921f-5523-4063-89d9-1fe690669fb9] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:40:42.468252 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-9bbdb05d-db1e-41ff-af63-9e11507b43d7 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:40:42.468992 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-9bbdb05d-db1e-41ff-af63-9e11507b43d7 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:40:42.470059 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-9bbdb05d-db1e-41ff-af63-9e11507b43d7 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:40:42.470731 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-9bbdb05d-db1e-41ff-af63-9e11507b43d7 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:40:42.626184 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-31bbfe2a-316f-439f-8238-4dfe6a923ae0 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:40:42.627382 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-31bbfe2a-316f-439f-8238-4dfe6a923ae0 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] [instance: f49079c1-1384-4136-b6cf-eadc40fb5aa1] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:40:42.640005 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-31bbfe2a-316f-439f-8238-4dfe6a923ae0 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:40:42.640720 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-31bbfe2a-316f-439f-8238-4dfe6a923ae0 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:40:42.641670 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-31bbfe2a-316f-439f-8238-4dfe6a923ae0 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:40:42.642256 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-31bbfe2a-316f-439f-8238-4dfe6a923ae0 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:40:42.688883 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-9bbdb05d-db1e-41ff-af63-9e11507b43d7 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d09fe912b4c4cab81b00df801f69680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2496096b374f399606bff9a08b65eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:40:42.692683 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG dbcounter [-] [129349] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 10:40:42.700849 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-9bbdb05d-db1e-41ff-af63-9e11507b43d7 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] 10.222.0.42 "GET /compute/v2.1/servers/f835921f-5523-4063-89d9-1fe690669fb9" status: 200 len: 1260 microversion: 2.1 time: 0.245390 Jun 06 10:40:42.712976 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 172/318] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:40:42 2022] GET /compute/v2.1/servers/f835921f-5523-4063-89d9-1fe690669fb9 => generated 1260 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:40:42.810002 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-31bbfe2a-316f-439f-8238-4dfe6a923ae0 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b7d82c999646b6b6b96d565f0e3f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe30c756a2f84166ad23af1edf83157e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:40:42.819832 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-31bbfe2a-316f-439f-8238-4dfe6a923ae0 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] 10.222.0.42 "GET /compute/v2.1/servers/f49079c1-1384-4136-b6cf-eadc40fb5aa1" status: 200 len: 1708 microversion: 2.1 time: 0.197985 Jun 06 10:40:42.820448 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 147/319] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:40:42 2022] GET /compute/v2.1/servers/f49079c1-1384-4136-b6cf-eadc40fb5aa1 => generated 1708 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 10:40:43.255396 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-9c81956a-b313-4677-8f74-a560d36763bb tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:40:43.256370 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-9c81956a-b313-4677-8f74-a560d36763bb tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] [instance: 5a0a79a6-8e61-477e-8269-730dfb6d04a6] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:40:43.266814 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-9c81956a-b313-4677-8f74-a560d36763bb tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:40:43.267260 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-9c81956a-b313-4677-8f74-a560d36763bb tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:40:43.268064 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-9c81956a-b313-4677-8f74-a560d36763bb tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:40:43.268851 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-9c81956a-b313-4677-8f74-a560d36763bb tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:40:43.437485 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-9c81956a-b313-4677-8f74-a560d36763bb tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:40:43.447547 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-9c81956a-b313-4677-8f74-a560d36763bb tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:40:43.449440 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-9c81956a-b313-4677-8f74-a560d36763bb tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:40:43.451442 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-9c81956a-b313-4677-8f74-a560d36763bb tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0a79a6-8e61-477e-8269-730dfb6d04a6" status: 200 len: 1743 microversion: 2.20 time: 0.200531 Jun 06 10:40:43.452670 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 173/320] 10.222.0.42 () {60 vars in 1276 bytes} [Mon Jun 6 10:40:43 2022] GET /compute/v2.1/servers/5a0a79a6-8e61-477e-8269-730dfb6d04a6 => generated 1743 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 06 10:40:43.719959 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-2243c47a-e841-4c6e-8a9d-68b4846e2f4b tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:40:43.721253 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-2243c47a-e841-4c6e-8a9d-68b4846e2f4b tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] [instance: f835921f-5523-4063-89d9-1fe690669fb9] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:40:43.728442 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-2243c47a-e841-4c6e-8a9d-68b4846e2f4b tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:40:43.728882 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-2243c47a-e841-4c6e-8a9d-68b4846e2f4b tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:40:43.729643 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-2243c47a-e841-4c6e-8a9d-68b4846e2f4b tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:40:43.730069 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-2243c47a-e841-4c6e-8a9d-68b4846e2f4b tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:40:43.837176 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-5319865b-c418-483d-9f98-8b14faa4d2d5 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:40:43.837936 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-5319865b-c418-483d-9f98-8b14faa4d2d5 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] [instance: f49079c1-1384-4136-b6cf-eadc40fb5aa1] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:40:43.844204 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-5319865b-c418-483d-9f98-8b14faa4d2d5 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:40:43.857559 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-5319865b-c418-483d-9f98-8b14faa4d2d5 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:40:43.858574 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-5319865b-c418-483d-9f98-8b14faa4d2d5 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:40:43.859232 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-5319865b-c418-483d-9f98-8b14faa4d2d5 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:40:43.885578 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-2243c47a-e841-4c6e-8a9d-68b4846e2f4b tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d09fe912b4c4cab81b00df801f69680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2496096b374f399606bff9a08b65eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:40:43.893351 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-2243c47a-e841-4c6e-8a9d-68b4846e2f4b tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] 10.222.0.42 "GET /compute/v2.1/servers/f835921f-5523-4063-89d9-1fe690669fb9" status: 200 len: 1260 microversion: 2.1 time: 0.177184 Jun 06 10:40:43.894683 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 148/321] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:40:43 2022] GET /compute/v2.1/servers/f835921f-5523-4063-89d9-1fe690669fb9 => generated 1260 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:40:44.015668 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-5319865b-c418-483d-9f98-8b14faa4d2d5 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b7d82c999646b6b6b96d565f0e3f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe30c756a2f84166ad23af1edf83157e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:40:44.025294 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-5319865b-c418-483d-9f98-8b14faa4d2d5 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] 10.222.0.42 "GET /compute/v2.1/servers/f49079c1-1384-4136-b6cf-eadc40fb5aa1" status: 200 len: 1708 microversion: 2.1 time: 0.192260 Jun 06 10:40:44.026249 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 174/322] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:40:43 2022] GET /compute/v2.1/servers/f49079c1-1384-4136-b6cf-eadc40fb5aa1 => generated 1708 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:40:44.470814 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-f29d2742-2e34-401f-a461-6fb29af51ea3 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:40:44.472015 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-f29d2742-2e34-401f-a461-6fb29af51ea3 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] [instance: 5a0a79a6-8e61-477e-8269-730dfb6d04a6] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:40:44.478964 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-f29d2742-2e34-401f-a461-6fb29af51ea3 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:40:44.479435 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-f29d2742-2e34-401f-a461-6fb29af51ea3 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:40:44.480228 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-f29d2742-2e34-401f-a461-6fb29af51ea3 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:40:44.480713 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-f29d2742-2e34-401f-a461-6fb29af51ea3 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:40:44.632596 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-f29d2742-2e34-401f-a461-6fb29af51ea3 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:40:44.642782 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-f29d2742-2e34-401f-a461-6fb29af51ea3 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:40:44.644861 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-f29d2742-2e34-401f-a461-6fb29af51ea3 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:40:44.646129 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-f29d2742-2e34-401f-a461-6fb29af51ea3 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0a79a6-8e61-477e-8269-730dfb6d04a6" status: 200 len: 1743 microversion: 2.20 time: 0.179275 Jun 06 10:40:44.647056 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 149/323] 10.222.0.42 () {60 vars in 1276 bytes} [Mon Jun 6 10:40:44 2022] GET /compute/v2.1/servers/5a0a79a6-8e61-477e-8269-730dfb6d04a6 => generated 1743 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 10:40:44.912623 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-401e586b-4aad-4d30-b099-b5b3f8b2bde7 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:40:44.914374 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-401e586b-4aad-4d30-b099-b5b3f8b2bde7 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] [instance: f835921f-5523-4063-89d9-1fe690669fb9] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:40:44.925096 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-401e586b-4aad-4d30-b099-b5b3f8b2bde7 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:40:44.925902 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-401e586b-4aad-4d30-b099-b5b3f8b2bde7 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:40:44.926909 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-401e586b-4aad-4d30-b099-b5b3f8b2bde7 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:40:44.927562 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-401e586b-4aad-4d30-b099-b5b3f8b2bde7 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:40:45.046257 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-ccb6ce1e-3edd-4afb-ad97-5bdfcca1b925 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:40:45.048391 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-ccb6ce1e-3edd-4afb-ad97-5bdfcca1b925 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] [instance: f49079c1-1384-4136-b6cf-eadc40fb5aa1] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:40:45.068281 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-ccb6ce1e-3edd-4afb-ad97-5bdfcca1b925 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:40:45.069093 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-ccb6ce1e-3edd-4afb-ad97-5bdfcca1b925 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:40:45.071121 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-ccb6ce1e-3edd-4afb-ad97-5bdfcca1b925 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:40:45.072438 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-ccb6ce1e-3edd-4afb-ad97-5bdfcca1b925 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:40:45.161734 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-401e586b-4aad-4d30-b099-b5b3f8b2bde7 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d09fe912b4c4cab81b00df801f69680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2496096b374f399606bff9a08b65eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:40:45.170287 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-401e586b-4aad-4d30-b099-b5b3f8b2bde7 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] 10.222.0.42 "GET /compute/v2.1/servers/f835921f-5523-4063-89d9-1fe690669fb9" status: 200 len: 1260 microversion: 2.1 time: 0.263112 Jun 06 10:40:45.189559 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 175/324] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:40:44 2022] GET /compute/v2.1/servers/f835921f-5523-4063-89d9-1fe690669fb9 => generated 1260 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:40:45.296185 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-ccb6ce1e-3edd-4afb-ad97-5bdfcca1b925 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b7d82c999646b6b6b96d565f0e3f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe30c756a2f84166ad23af1edf83157e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:40:45.308310 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-ccb6ce1e-3edd-4afb-ad97-5bdfcca1b925 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] 10.222.0.42 "GET /compute/v2.1/servers/f49079c1-1384-4136-b6cf-eadc40fb5aa1" status: 200 len: 1708 microversion: 2.1 time: 0.269094 Jun 06 10:40:45.310925 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 150/325] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:40:45 2022] GET /compute/v2.1/servers/f49079c1-1384-4136-b6cf-eadc40fb5aa1 => generated 1708 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:40:45.664775 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-8211623b-d6aa-4998-b479-ded4fcc45402 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:40:45.665487 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-8211623b-d6aa-4998-b479-ded4fcc45402 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] [instance: 5a0a79a6-8e61-477e-8269-730dfb6d04a6] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:40:45.667490 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG dbcounter [-] [129349] Writing DB stats nova_cell0:SELECT=2 {{(pid=129349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 10:40:45.676605 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-8211623b-d6aa-4998-b479-ded4fcc45402 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:40:45.676605 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-8211623b-d6aa-4998-b479-ded4fcc45402 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:40:45.676605 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-8211623b-d6aa-4998-b479-ded4fcc45402 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:40:45.676605 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-8211623b-d6aa-4998-b479-ded4fcc45402 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:40:45.830956 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-8211623b-d6aa-4998-b479-ded4fcc45402 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:40:45.840847 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-8211623b-d6aa-4998-b479-ded4fcc45402 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:40:45.842447 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-8211623b-d6aa-4998-b479-ded4fcc45402 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:40:45.843828 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-8211623b-d6aa-4998-b479-ded4fcc45402 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0a79a6-8e61-477e-8269-730dfb6d04a6" status: 200 len: 1743 microversion: 2.20 time: 0.182826 Jun 06 10:40:45.858601 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 176/326] 10.222.0.42 () {60 vars in 1276 bytes} [Mon Jun 6 10:40:45 2022] GET /compute/v2.1/servers/5a0a79a6-8e61-477e-8269-730dfb6d04a6 => generated 1743 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 10:40:46.188540 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-36c31b76-1189-4143-b1c0-f668c166b9c3 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:40:46.189243 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-36c31b76-1189-4143-b1c0-f668c166b9c3 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] [instance: f835921f-5523-4063-89d9-1fe690669fb9] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:40:46.198091 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-36c31b76-1189-4143-b1c0-f668c166b9c3 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:40:46.204963 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-36c31b76-1189-4143-b1c0-f668c166b9c3 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:40:46.206218 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-36c31b76-1189-4143-b1c0-f668c166b9c3 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:40:46.206668 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-36c31b76-1189-4143-b1c0-f668c166b9c3 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:40:46.331881 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-306c9f3b-3add-49e5-b4b6-b149ba8af75c tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:40:46.333194 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-306c9f3b-3add-49e5-b4b6-b149ba8af75c tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] [instance: f49079c1-1384-4136-b6cf-eadc40fb5aa1] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:40:46.341901 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG dbcounter [-] [129349] Writing DB stats nova_cell0:SELECT=8 {{(pid=129349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 10:40:46.355512 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-306c9f3b-3add-49e5-b4b6-b149ba8af75c tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:40:46.356411 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-306c9f3b-3add-49e5-b4b6-b149ba8af75c tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:40:46.358757 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-306c9f3b-3add-49e5-b4b6-b149ba8af75c tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:40:46.359665 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-306c9f3b-3add-49e5-b4b6-b149ba8af75c tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:40:46.576000 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-36c31b76-1189-4143-b1c0-f668c166b9c3 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d09fe912b4c4cab81b00df801f69680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2496096b374f399606bff9a08b65eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:40:46.591070 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-36c31b76-1189-4143-b1c0-f668c166b9c3 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] 10.222.0.42 "GET /compute/v2.1/servers/f835921f-5523-4063-89d9-1fe690669fb9" status: 200 len: 1260 microversion: 2.1 time: 0.406748 Jun 06 10:40:46.591758 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 151/327] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:40:46 2022] GET /compute/v2.1/servers/f835921f-5523-4063-89d9-1fe690669fb9 => generated 1260 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:40:46.691139 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-306c9f3b-3add-49e5-b4b6-b149ba8af75c tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b7d82c999646b6b6b96d565f0e3f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe30c756a2f84166ad23af1edf83157e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:40:46.702242 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-306c9f3b-3add-49e5-b4b6-b149ba8af75c tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] 10.222.0.42 "GET /compute/v2.1/servers/f49079c1-1384-4136-b6cf-eadc40fb5aa1" status: 200 len: 1708 microversion: 2.1 time: 0.376128 Jun 06 10:40:46.703250 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 177/328] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:40:46 2022] GET /compute/v2.1/servers/f49079c1-1384-4136-b6cf-eadc40fb5aa1 => generated 1708 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 10:40:46.864521 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-9aab0873-3946-4f07-9a4e-5eaf1bae9e19 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:40:46.865134 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-9aab0873-3946-4f07-9a4e-5eaf1bae9e19 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] [instance: 5a0a79a6-8e61-477e-8269-730dfb6d04a6] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:40:46.872305 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-9aab0873-3946-4f07-9a4e-5eaf1bae9e19 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:40:46.873409 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-9aab0873-3946-4f07-9a4e-5eaf1bae9e19 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:40:46.874372 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-9aab0873-3946-4f07-9a4e-5eaf1bae9e19 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:40:46.875072 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-9aab0873-3946-4f07-9a4e-5eaf1bae9e19 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:40:47.234496 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-9aab0873-3946-4f07-9a4e-5eaf1bae9e19 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:40:47.243869 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-9aab0873-3946-4f07-9a4e-5eaf1bae9e19 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:40:47.245388 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-9aab0873-3946-4f07-9a4e-5eaf1bae9e19 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:40:47.246661 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-9aab0873-3946-4f07-9a4e-5eaf1bae9e19 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0a79a6-8e61-477e-8269-730dfb6d04a6" status: 200 len: 1743 microversion: 2.20 time: 0.387615 Jun 06 10:40:47.247211 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 152/329] 10.222.0.42 () {60 vars in 1276 bytes} [Mon Jun 6 10:40:46 2022] GET /compute/v2.1/servers/5a0a79a6-8e61-477e-8269-730dfb6d04a6 => generated 1743 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 10:40:47.608732 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-55102970-1861-483a-b6cb-f3f9562e28d5 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:40:47.609664 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-55102970-1861-483a-b6cb-f3f9562e28d5 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] [instance: f835921f-5523-4063-89d9-1fe690669fb9] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:40:47.617135 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-55102970-1861-483a-b6cb-f3f9562e28d5 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:40:47.617874 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-55102970-1861-483a-b6cb-f3f9562e28d5 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:40:47.618991 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-55102970-1861-483a-b6cb-f3f9562e28d5 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:40:47.619535 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-55102970-1861-483a-b6cb-f3f9562e28d5 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:40:47.724528 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-d56a925d-2d39-45a3-8aba-119976232de2 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:40:47.725416 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-d56a925d-2d39-45a3-8aba-119976232de2 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] [instance: f49079c1-1384-4136-b6cf-eadc40fb5aa1] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:40:47.732921 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-d56a925d-2d39-45a3-8aba-119976232de2 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:40:47.733722 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-d56a925d-2d39-45a3-8aba-119976232de2 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:40:47.734713 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-d56a925d-2d39-45a3-8aba-119976232de2 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:40:47.735324 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-d56a925d-2d39-45a3-8aba-119976232de2 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:40:47.778203 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-55102970-1861-483a-b6cb-f3f9562e28d5 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d09fe912b4c4cab81b00df801f69680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2496096b374f399606bff9a08b65eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:40:47.787097 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-55102970-1861-483a-b6cb-f3f9562e28d5 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] 10.222.0.42 "GET /compute/v2.1/servers/f835921f-5523-4063-89d9-1fe690669fb9" status: 200 len: 1260 microversion: 2.1 time: 0.182369 Jun 06 10:40:47.797378 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 178/330] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:40:47 2022] GET /compute/v2.1/servers/f835921f-5523-4063-89d9-1fe690669fb9 => generated 1260 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:40:47.911138 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-d56a925d-2d39-45a3-8aba-119976232de2 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b7d82c999646b6b6b96d565f0e3f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe30c756a2f84166ad23af1edf83157e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:40:47.914118 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-d56a925d-2d39-45a3-8aba-119976232de2 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] 10.222.0.42 "GET /compute/v2.1/servers/f49079c1-1384-4136-b6cf-eadc40fb5aa1" status: 200 len: 1708 microversion: 2.1 time: 0.195691 Jun 06 10:40:47.920170 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 153/331] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:40:47 2022] GET /compute/v2.1/servers/f49079c1-1384-4136-b6cf-eadc40fb5aa1 => generated 1708 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:40:48.266891 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-68901721-45b2-437c-8f7c-0aa3c291f90b tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:40:48.267908 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-68901721-45b2-437c-8f7c-0aa3c291f90b tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] [instance: 5a0a79a6-8e61-477e-8269-730dfb6d04a6] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:40:48.275681 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-68901721-45b2-437c-8f7c-0aa3c291f90b tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:40:48.276342 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-68901721-45b2-437c-8f7c-0aa3c291f90b tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:40:48.277305 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-68901721-45b2-437c-8f7c-0aa3c291f90b tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:40:48.278229 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-68901721-45b2-437c-8f7c-0aa3c291f90b tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:40:48.414914 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [req-acc68741-8739-4412-a4e8-eb7d20c3b771 req-0727a45b-0542-4f5a-be28-b0cc5b852f89 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a0a79a6-8e61-477e-8269-730dfb6d04a6", "name": "network-vif-plugged", "status": "completed", "tag": "581fdfa4-6fbc-445e-ad43-e4ef71127c0e"}]} {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 10:40:48.425181 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [req-acc68741-8739-4412-a4e8-eb7d20c3b771 req-0727a45b-0542-4f5a-be28-b0cc5b852f89 service nova] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:40:48.426001 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [req-acc68741-8739-4412-a4e8-eb7d20c3b771 req-0727a45b-0542-4f5a-be28-b0cc5b852f89 service nova] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:40:48.439082 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.compute.server_external_events [req-acc68741-8739-4412-a4e8-eb7d20c3b771 req-0727a45b-0542-4f5a-be28-b0cc5b852f89 service nova] Creating event network-vif-plugged:581fdfa4-6fbc-445e-ad43-e4ef71127c0e for instance 5a0a79a6-8e61-477e-8269-730dfb6d04a6 on hv-cinder-84482 Jun 06 10:40:48.445187 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [req-acc68741-8739-4412-a4e8-eb7d20c3b771 req-0727a45b-0542-4f5a-be28-b0cc5b852f89 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036303 Jun 06 10:40:48.446933 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 154/332] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Jun 6 10:40:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 06 10:40:48.481058 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-68901721-45b2-437c-8f7c-0aa3c291f90b tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:40:48.495735 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-68901721-45b2-437c-8f7c-0aa3c291f90b tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:40:48.497258 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-68901721-45b2-437c-8f7c-0aa3c291f90b tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:40:48.498499 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-68901721-45b2-437c-8f7c-0aa3c291f90b tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0a79a6-8e61-477e-8269-730dfb6d04a6" status: 200 len: 1743 microversion: 2.20 time: 0.236190 Jun 06 10:40:48.498979 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 179/333] 10.222.0.42 () {60 vars in 1276 bytes} [Mon Jun 6 10:40:48 2022] GET /compute/v2.1/servers/5a0a79a6-8e61-477e-8269-730dfb6d04a6 => generated 1743 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 10:40:48.808489 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-bebf76d6-fafb-442d-83c3-ca951def18c5 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:40:48.809208 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-bebf76d6-fafb-442d-83c3-ca951def18c5 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] [instance: f835921f-5523-4063-89d9-1fe690669fb9] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:40:48.816199 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-bebf76d6-fafb-442d-83c3-ca951def18c5 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:40:48.816509 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-bebf76d6-fafb-442d-83c3-ca951def18c5 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:40:48.817483 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-bebf76d6-fafb-442d-83c3-ca951def18c5 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:40:48.818065 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-bebf76d6-fafb-442d-83c3-ca951def18c5 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:40:48.932531 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-3dfe3b5c-bd0f-4a46-905c-94aafd6c86e5 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:40:48.933855 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-3dfe3b5c-bd0f-4a46-905c-94aafd6c86e5 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] [instance: f49079c1-1384-4136-b6cf-eadc40fb5aa1] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:40:48.941413 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-3dfe3b5c-bd0f-4a46-905c-94aafd6c86e5 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:40:48.942086 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-3dfe3b5c-bd0f-4a46-905c-94aafd6c86e5 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:40:48.943487 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-3dfe3b5c-bd0f-4a46-905c-94aafd6c86e5 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:40:48.944618 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-3dfe3b5c-bd0f-4a46-905c-94aafd6c86e5 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:40:49.042282 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-bebf76d6-fafb-442d-83c3-ca951def18c5 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d09fe912b4c4cab81b00df801f69680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2496096b374f399606bff9a08b65eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:40:49.053666 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-bebf76d6-fafb-442d-83c3-ca951def18c5 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] 10.222.0.42 "GET /compute/v2.1/servers/f835921f-5523-4063-89d9-1fe690669fb9" status: 200 len: 1260 microversion: 2.1 time: 0.251385 Jun 06 10:40:49.054366 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 155/334] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:40:48 2022] GET /compute/v2.1/servers/f835921f-5523-4063-89d9-1fe690669fb9 => generated 1260 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:40:49.124348 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-3dfe3b5c-bd0f-4a46-905c-94aafd6c86e5 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b7d82c999646b6b6b96d565f0e3f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe30c756a2f84166ad23af1edf83157e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:40:49.132755 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-3dfe3b5c-bd0f-4a46-905c-94aafd6c86e5 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] 10.222.0.42 "GET /compute/v2.1/servers/f49079c1-1384-4136-b6cf-eadc40fb5aa1" status: 200 len: 1708 microversion: 2.1 time: 0.205093 Jun 06 10:40:49.139854 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 180/335] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:40:48 2022] GET /compute/v2.1/servers/f49079c1-1384-4136-b6cf-eadc40fb5aa1 => generated 1708 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:40:49.517666 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-b03fc181-17e5-48be-85f0-81f260c1bfe1 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:40:49.518291 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-b03fc181-17e5-48be-85f0-81f260c1bfe1 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] [instance: 5a0a79a6-8e61-477e-8269-730dfb6d04a6] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:40:49.525383 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-b03fc181-17e5-48be-85f0-81f260c1bfe1 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:40:49.526541 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-b03fc181-17e5-48be-85f0-81f260c1bfe1 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:40:49.527338 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-b03fc181-17e5-48be-85f0-81f260c1bfe1 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:40:49.527772 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-b03fc181-17e5-48be-85f0-81f260c1bfe1 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:40:49.681702 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-b03fc181-17e5-48be-85f0-81f260c1bfe1 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:40:49.690663 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-b03fc181-17e5-48be-85f0-81f260c1bfe1 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:40:49.692282 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-b03fc181-17e5-48be-85f0-81f260c1bfe1 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:40:49.693502 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-b03fc181-17e5-48be-85f0-81f260c1bfe1 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0a79a6-8e61-477e-8269-730dfb6d04a6" status: 200 len: 1743 microversion: 2.20 time: 0.180251 Jun 06 10:40:49.694147 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 156/336] 10.222.0.42 () {60 vars in 1276 bytes} [Mon Jun 6 10:40:49 2022] GET /compute/v2.1/servers/5a0a79a6-8e61-477e-8269-730dfb6d04a6 => generated 1743 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 06 10:40:50.071431 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-34502dd7-af3f-456a-b8c7-143cdab7e841 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:40:50.072089 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-34502dd7-af3f-456a-b8c7-143cdab7e841 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] [instance: f835921f-5523-4063-89d9-1fe690669fb9] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:40:50.078766 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-34502dd7-af3f-456a-b8c7-143cdab7e841 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:40:50.079413 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-34502dd7-af3f-456a-b8c7-143cdab7e841 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:40:50.080376 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-34502dd7-af3f-456a-b8c7-143cdab7e841 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:40:50.080809 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-34502dd7-af3f-456a-b8c7-143cdab7e841 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:40:50.152543 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-e338baef-f13f-4713-89f2-4c0544e74177 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:40:50.153438 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-e338baef-f13f-4713-89f2-4c0544e74177 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] [instance: f49079c1-1384-4136-b6cf-eadc40fb5aa1] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:40:50.161766 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-e338baef-f13f-4713-89f2-4c0544e74177 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:40:50.162477 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-e338baef-f13f-4713-89f2-4c0544e74177 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:40:50.163960 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-e338baef-f13f-4713-89f2-4c0544e74177 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:40:50.164666 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-e338baef-f13f-4713-89f2-4c0544e74177 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:40:50.276529 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-34502dd7-af3f-456a-b8c7-143cdab7e841 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d09fe912b4c4cab81b00df801f69680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2496096b374f399606bff9a08b65eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:40:50.284323 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-34502dd7-af3f-456a-b8c7-143cdab7e841 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] 10.222.0.42 "GET /compute/v2.1/servers/f835921f-5523-4063-89d9-1fe690669fb9" status: 200 len: 1260 microversion: 2.1 time: 0.217477 Jun 06 10:40:50.288785 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 181/337] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:40:50 2022] GET /compute/v2.1/servers/f835921f-5523-4063-89d9-1fe690669fb9 => generated 1260 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:40:50.339017 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-e338baef-f13f-4713-89f2-4c0544e74177 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b7d82c999646b6b6b96d565f0e3f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe30c756a2f84166ad23af1edf83157e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:40:50.347632 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-e338baef-f13f-4713-89f2-4c0544e74177 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] 10.222.0.42 "GET /compute/v2.1/servers/f49079c1-1384-4136-b6cf-eadc40fb5aa1" status: 200 len: 1708 microversion: 2.1 time: 0.198863 Jun 06 10:40:50.348408 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 157/338] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:40:50 2022] GET /compute/v2.1/servers/f49079c1-1384-4136-b6cf-eadc40fb5aa1 => generated 1708 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:40:50.712484 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-9ae394a1-f620-4033-93b1-2bd4d8f2185e tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:40:50.713115 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-9ae394a1-f620-4033-93b1-2bd4d8f2185e tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] [instance: 5a0a79a6-8e61-477e-8269-730dfb6d04a6] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:40:50.719599 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-9ae394a1-f620-4033-93b1-2bd4d8f2185e tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:40:50.719599 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-9ae394a1-f620-4033-93b1-2bd4d8f2185e tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:40:50.720312 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-9ae394a1-f620-4033-93b1-2bd4d8f2185e tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:40:50.720696 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-9ae394a1-f620-4033-93b1-2bd4d8f2185e tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:40:50.870699 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-9ae394a1-f620-4033-93b1-2bd4d8f2185e tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:40:50.878795 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-9ae394a1-f620-4033-93b1-2bd4d8f2185e tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:40:50.880416 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-9ae394a1-f620-4033-93b1-2bd4d8f2185e tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:40:50.882195 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-9ae394a1-f620-4033-93b1-2bd4d8f2185e tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0a79a6-8e61-477e-8269-730dfb6d04a6" status: 200 len: 1743 microversion: 2.20 time: 0.173483 Jun 06 10:40:50.882800 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 182/339] 10.222.0.42 () {60 vars in 1276 bytes} [Mon Jun 6 10:40:50 2022] GET /compute/v2.1/servers/5a0a79a6-8e61-477e-8269-730dfb6d04a6 => generated 1743 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 10:40:51.304583 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-2b8e2c83-2d8a-4657-8564-2a2a1549efd4 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:40:51.305127 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-2b8e2c83-2d8a-4657-8564-2a2a1549efd4 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] [instance: f835921f-5523-4063-89d9-1fe690669fb9] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:40:51.312017 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-2b8e2c83-2d8a-4657-8564-2a2a1549efd4 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:40:51.312462 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-2b8e2c83-2d8a-4657-8564-2a2a1549efd4 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:40:51.313223 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-2b8e2c83-2d8a-4657-8564-2a2a1549efd4 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:40:51.313654 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-2b8e2c83-2d8a-4657-8564-2a2a1549efd4 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:40:51.365048 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-3bb8b173-bf98-49c8-a704-bf679ad1ecb2 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:40:51.365672 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-3bb8b173-bf98-49c8-a704-bf679ad1ecb2 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] [instance: f49079c1-1384-4136-b6cf-eadc40fb5aa1] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:40:51.372338 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-3bb8b173-bf98-49c8-a704-bf679ad1ecb2 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:40:51.372786 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-3bb8b173-bf98-49c8-a704-bf679ad1ecb2 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:40:51.373558 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-3bb8b173-bf98-49c8-a704-bf679ad1ecb2 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:40:51.373999 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-3bb8b173-bf98-49c8-a704-bf679ad1ecb2 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:40:51.490716 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-2b8e2c83-2d8a-4657-8564-2a2a1549efd4 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d09fe912b4c4cab81b00df801f69680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2496096b374f399606bff9a08b65eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:40:51.499624 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-2b8e2c83-2d8a-4657-8564-2a2a1549efd4 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] 10.222.0.42 "GET /compute/v2.1/servers/f835921f-5523-4063-89d9-1fe690669fb9" status: 200 len: 1260 microversion: 2.1 time: 0.198943 Jun 06 10:40:51.500425 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 158/340] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:40:51 2022] GET /compute/v2.1/servers/f835921f-5523-4063-89d9-1fe690669fb9 => generated 1260 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:40:51.544625 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-3bb8b173-bf98-49c8-a704-bf679ad1ecb2 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b7d82c999646b6b6b96d565f0e3f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe30c756a2f84166ad23af1edf83157e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:40:51.552554 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-3bb8b173-bf98-49c8-a704-bf679ad1ecb2 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] 10.222.0.42 "GET /compute/v2.1/servers/f49079c1-1384-4136-b6cf-eadc40fb5aa1" status: 200 len: 1712 microversion: 2.1 time: 0.191353 Jun 06 10:40:51.553114 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 183/341] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:40:51 2022] GET /compute/v2.1/servers/f49079c1-1384-4136-b6cf-eadc40fb5aa1 => generated 1712 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 10:40:51.901463 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-93ab6a48-44ef-44fa-8ef8-45e5a9efe6cb tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:40:51.901568 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-93ab6a48-44ef-44fa-8ef8-45e5a9efe6cb tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] [instance: 5a0a79a6-8e61-477e-8269-730dfb6d04a6] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:40:51.907739 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-93ab6a48-44ef-44fa-8ef8-45e5a9efe6cb tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:40:51.908286 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-93ab6a48-44ef-44fa-8ef8-45e5a9efe6cb tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:40:51.909050 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-93ab6a48-44ef-44fa-8ef8-45e5a9efe6cb tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:40:51.909480 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-93ab6a48-44ef-44fa-8ef8-45e5a9efe6cb tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:40:52.040361 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-93ab6a48-44ef-44fa-8ef8-45e5a9efe6cb tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:40:52.048069 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-93ab6a48-44ef-44fa-8ef8-45e5a9efe6cb tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:40:52.049581 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-93ab6a48-44ef-44fa-8ef8-45e5a9efe6cb tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:40:52.050758 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-93ab6a48-44ef-44fa-8ef8-45e5a9efe6cb tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0a79a6-8e61-477e-8269-730dfb6d04a6" status: 200 len: 1743 microversion: 2.20 time: 0.154775 Jun 06 10:40:52.051308 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 159/342] 10.222.0.42 () {60 vars in 1276 bytes} [Mon Jun 6 10:40:51 2022] GET /compute/v2.1/servers/5a0a79a6-8e61-477e-8269-730dfb6d04a6 => generated 1743 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 10:40:52.516327 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-3e9f31c3-0ed4-433e-b281-13586df10f67 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:40:52.516945 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-3e9f31c3-0ed4-433e-b281-13586df10f67 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] [instance: f835921f-5523-4063-89d9-1fe690669fb9] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:40:52.524242 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-3e9f31c3-0ed4-433e-b281-13586df10f67 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:40:52.524692 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-3e9f31c3-0ed4-433e-b281-13586df10f67 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:40:52.525674 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-3e9f31c3-0ed4-433e-b281-13586df10f67 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:40:52.526120 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-3e9f31c3-0ed4-433e-b281-13586df10f67 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:40:52.660202 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-3e9f31c3-0ed4-433e-b281-13586df10f67 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d09fe912b4c4cab81b00df801f69680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2496096b374f399606bff9a08b65eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:40:52.668942 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-3e9f31c3-0ed4-433e-b281-13586df10f67 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] 10.222.0.42 "GET /compute/v2.1/servers/f835921f-5523-4063-89d9-1fe690669fb9" status: 200 len: 1260 microversion: 2.1 time: 0.156466 Jun 06 10:40:52.669513 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 184/343] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:40:52 2022] GET /compute/v2.1/servers/f835921f-5523-4063-89d9-1fe690669fb9 => generated 1260 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:40:53.068116 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-e4b97306-9908-452c-b645-b6f0504be082 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:40:53.068648 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-e4b97306-9908-452c-b645-b6f0504be082 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] [instance: 5a0a79a6-8e61-477e-8269-730dfb6d04a6] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:40:53.076333 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-e4b97306-9908-452c-b645-b6f0504be082 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:40:53.076777 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-e4b97306-9908-452c-b645-b6f0504be082 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:40:53.077528 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-e4b97306-9908-452c-b645-b6f0504be082 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:40:53.077956 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-e4b97306-9908-452c-b645-b6f0504be082 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:40:53.210842 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-e4b97306-9908-452c-b645-b6f0504be082 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:40:53.219407 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-e4b97306-9908-452c-b645-b6f0504be082 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:40:53.220936 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-e4b97306-9908-452c-b645-b6f0504be082 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:40:53.222070 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-e4b97306-9908-452c-b645-b6f0504be082 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0a79a6-8e61-477e-8269-730dfb6d04a6" status: 200 len: 1743 microversion: 2.20 time: 0.157958 Jun 06 10:40:53.222627 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 160/344] 10.222.0.42 () {60 vars in 1276 bytes} [Mon Jun 6 10:40:53 2022] GET /compute/v2.1/servers/5a0a79a6-8e61-477e-8269-730dfb6d04a6 => generated 1743 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 10:40:53.685402 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-c4105f6c-957f-457e-bbb8-a1716f91a05e tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:40:53.686013 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-c4105f6c-957f-457e-bbb8-a1716f91a05e tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] [instance: f835921f-5523-4063-89d9-1fe690669fb9] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:40:53.692427 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-c4105f6c-957f-457e-bbb8-a1716f91a05e tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:40:53.692876 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-c4105f6c-957f-457e-bbb8-a1716f91a05e tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:40:53.693632 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-c4105f6c-957f-457e-bbb8-a1716f91a05e tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:40:53.694069 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-c4105f6c-957f-457e-bbb8-a1716f91a05e tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:40:53.823944 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-c4105f6c-957f-457e-bbb8-a1716f91a05e tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d09fe912b4c4cab81b00df801f69680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2496096b374f399606bff9a08b65eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:40:53.831281 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-c4105f6c-957f-457e-bbb8-a1716f91a05e tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] 10.222.0.42 "GET /compute/v2.1/servers/f835921f-5523-4063-89d9-1fe690669fb9" status: 200 len: 1260 microversion: 2.1 time: 0.149681 Jun 06 10:40:53.831991 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 185/345] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:40:53 2022] GET /compute/v2.1/servers/f835921f-5523-4063-89d9-1fe690669fb9 => generated 1260 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:40:54.241125 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-135b3260-109a-4f64-949c-a473dfdbc11b tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:40:54.241761 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-135b3260-109a-4f64-949c-a473dfdbc11b tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] [instance: 5a0a79a6-8e61-477e-8269-730dfb6d04a6] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:40:54.248429 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-135b3260-109a-4f64-949c-a473dfdbc11b tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:40:54.248874 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-135b3260-109a-4f64-949c-a473dfdbc11b tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:40:54.249634 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-135b3260-109a-4f64-949c-a473dfdbc11b tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:40:54.250067 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-135b3260-109a-4f64-949c-a473dfdbc11b tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:40:54.387615 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-135b3260-109a-4f64-949c-a473dfdbc11b tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:40:54.395940 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-135b3260-109a-4f64-949c-a473dfdbc11b tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:40:54.397791 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-135b3260-109a-4f64-949c-a473dfdbc11b tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:40:54.398944 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-135b3260-109a-4f64-949c-a473dfdbc11b tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0a79a6-8e61-477e-8269-730dfb6d04a6" status: 200 len: 1743 microversion: 2.20 time: 0.161827 Jun 06 10:40:54.399493 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 161/346] 10.222.0.42 () {60 vars in 1276 bytes} [Mon Jun 6 10:40:54 2022] GET /compute/v2.1/servers/5a0a79a6-8e61-477e-8269-730dfb6d04a6 => generated 1743 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 10:40:54.853151 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-74a7e396-29e6-411e-8731-059609294955 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:40:54.855123 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-74a7e396-29e6-411e-8731-059609294955 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] [instance: f835921f-5523-4063-89d9-1fe690669fb9] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:40:54.864563 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-74a7e396-29e6-411e-8731-059609294955 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:40:54.865324 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-74a7e396-29e6-411e-8731-059609294955 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:40:54.868161 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-74a7e396-29e6-411e-8731-059609294955 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:40:54.869335 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-74a7e396-29e6-411e-8731-059609294955 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:40:55.311491 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-74a7e396-29e6-411e-8731-059609294955 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d09fe912b4c4cab81b00df801f69680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2496096b374f399606bff9a08b65eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:40:55.320165 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-74a7e396-29e6-411e-8731-059609294955 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] 10.222.0.42 "GET /compute/v2.1/servers/f835921f-5523-4063-89d9-1fe690669fb9" status: 200 len: 1260 microversion: 2.1 time: 0.475040 Jun 06 10:40:55.330007 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 186/347] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:40:54 2022] GET /compute/v2.1/servers/f835921f-5523-4063-89d9-1fe690669fb9 => generated 1260 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:40:55.417750 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-a13710ff-0883-482e-8421-89b1d5c727df tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:40:55.418935 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-a13710ff-0883-482e-8421-89b1d5c727df tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] [instance: 5a0a79a6-8e61-477e-8269-730dfb6d04a6] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:40:55.433201 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-a13710ff-0883-482e-8421-89b1d5c727df tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:40:55.433823 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-a13710ff-0883-482e-8421-89b1d5c727df tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:40:55.434617 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-a13710ff-0883-482e-8421-89b1d5c727df tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:40:55.437403 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-a13710ff-0883-482e-8421-89b1d5c727df tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:40:55.647577 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-a13710ff-0883-482e-8421-89b1d5c727df tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:40:55.658119 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-a13710ff-0883-482e-8421-89b1d5c727df tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:40:55.659761 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-a13710ff-0883-482e-8421-89b1d5c727df tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:40:55.660959 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-a13710ff-0883-482e-8421-89b1d5c727df tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0a79a6-8e61-477e-8269-730dfb6d04a6" status: 200 len: 1738 microversion: 2.20 time: 0.247237 Jun 06 10:40:55.661571 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 162/348] 10.222.0.42 () {60 vars in 1276 bytes} [Mon Jun 6 10:40:55 2022] GET /compute/v2.1/servers/5a0a79a6-8e61-477e-8269-730dfb6d04a6 => generated 1738 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 06 10:40:56.338283 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-fbf8ecaa-d8b3-4c55-a73f-8a311a36c129 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:40:56.339514 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-fbf8ecaa-d8b3-4c55-a73f-8a311a36c129 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] [instance: f835921f-5523-4063-89d9-1fe690669fb9] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:40:56.350350 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-fbf8ecaa-d8b3-4c55-a73f-8a311a36c129 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:40:56.352359 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-fbf8ecaa-d8b3-4c55-a73f-8a311a36c129 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:40:56.353426 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-fbf8ecaa-d8b3-4c55-a73f-8a311a36c129 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:40:56.354583 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-fbf8ecaa-d8b3-4c55-a73f-8a311a36c129 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:40:56.563864 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-fbf8ecaa-d8b3-4c55-a73f-8a311a36c129 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d09fe912b4c4cab81b00df801f69680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2496096b374f399606bff9a08b65eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:40:56.572868 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-fbf8ecaa-d8b3-4c55-a73f-8a311a36c129 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] 10.222.0.42 "GET /compute/v2.1/servers/f835921f-5523-4063-89d9-1fe690669fb9" status: 200 len: 1260 microversion: 2.1 time: 0.239284 Jun 06 10:40:56.577585 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 187/349] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:40:56 2022] GET /compute/v2.1/servers/f835921f-5523-4063-89d9-1fe690669fb9 => generated 1260 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:40:56.682756 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-974fb8f8-22df-4978-a765-a62fef4c40a1 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:40:56.684376 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-974fb8f8-22df-4978-a765-a62fef4c40a1 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] [instance: 5a0a79a6-8e61-477e-8269-730dfb6d04a6] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:40:56.691964 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-974fb8f8-22df-4978-a765-a62fef4c40a1 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:40:56.692812 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-974fb8f8-22df-4978-a765-a62fef4c40a1 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:40:56.695254 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-974fb8f8-22df-4978-a765-a62fef4c40a1 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:40:56.695903 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-974fb8f8-22df-4978-a765-a62fef4c40a1 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:40:56.869467 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-974fb8f8-22df-4978-a765-a62fef4c40a1 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:40:56.872109 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG dbcounter [-] [129350] Writing DB stats nova_cell1:SELECT=100 {{(pid=129350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 10:40:56.879917 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-974fb8f8-22df-4978-a765-a62fef4c40a1 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:40:56.882863 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-974fb8f8-22df-4978-a765-a62fef4c40a1 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:40:56.885016 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-974fb8f8-22df-4978-a765-a62fef4c40a1 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0a79a6-8e61-477e-8269-730dfb6d04a6" status: 200 len: 1738 microversion: 2.20 time: 0.207957 Jun 06 10:40:56.885730 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 163/350] 10.222.0.42 () {60 vars in 1276 bytes} [Mon Jun 6 10:40:56 2022] GET /compute/v2.1/servers/5a0a79a6-8e61-477e-8269-730dfb6d04a6 => generated 1738 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 10:40:57.594874 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-6871ca89-6d11-48a5-b62e-dc2d97ac2141 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:40:57.595617 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-6871ca89-6d11-48a5-b62e-dc2d97ac2141 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] [instance: f835921f-5523-4063-89d9-1fe690669fb9] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:40:57.604224 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-6871ca89-6d11-48a5-b62e-dc2d97ac2141 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:40:57.604670 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-6871ca89-6d11-48a5-b62e-dc2d97ac2141 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:40:57.605442 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-6871ca89-6d11-48a5-b62e-dc2d97ac2141 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:40:57.605871 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-6871ca89-6d11-48a5-b62e-dc2d97ac2141 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:40:57.824521 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-6871ca89-6d11-48a5-b62e-dc2d97ac2141 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d09fe912b4c4cab81b00df801f69680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2496096b374f399606bff9a08b65eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:40:57.833149 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-6871ca89-6d11-48a5-b62e-dc2d97ac2141 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] 10.222.0.42 "GET /compute/v2.1/servers/f835921f-5523-4063-89d9-1fe690669fb9" status: 200 len: 1260 microversion: 2.1 time: 0.242089 Jun 06 10:40:57.845352 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 188/351] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:40:57 2022] GET /compute/v2.1/servers/f835921f-5523-4063-89d9-1fe690669fb9 => generated 1260 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:40:57.910811 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-4ec36b55-6a2b-47a5-ac98-63ff11d5dc91 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:40:57.911475 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-4ec36b55-6a2b-47a5-ac98-63ff11d5dc91 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] [instance: 5a0a79a6-8e61-477e-8269-730dfb6d04a6] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:40:57.938395 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-4ec36b55-6a2b-47a5-ac98-63ff11d5dc91 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:40:57.939243 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-4ec36b55-6a2b-47a5-ac98-63ff11d5dc91 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:40:57.940689 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-4ec36b55-6a2b-47a5-ac98-63ff11d5dc91 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:40:57.943202 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-4ec36b55-6a2b-47a5-ac98-63ff11d5dc91 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:40:58.139619 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-4ec36b55-6a2b-47a5-ac98-63ff11d5dc91 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:40:58.151272 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-4ec36b55-6a2b-47a5-ac98-63ff11d5dc91 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:40:58.153079 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-4ec36b55-6a2b-47a5-ac98-63ff11d5dc91 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:40:58.154543 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-4ec36b55-6a2b-47a5-ac98-63ff11d5dc91 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0a79a6-8e61-477e-8269-730dfb6d04a6" status: 200 len: 1738 microversion: 2.20 time: 0.254753 Jun 06 10:40:58.155097 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 164/352] 10.222.0.42 () {60 vars in 1276 bytes} [Mon Jun 6 10:40:57 2022] GET /compute/v2.1/servers/5a0a79a6-8e61-477e-8269-730dfb6d04a6 => generated 1738 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 10:40:58.851268 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-cf66c3c7-96d4-4c41-8906-72ba86ece41f tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:40:58.852135 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-cf66c3c7-96d4-4c41-8906-72ba86ece41f tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] [instance: f835921f-5523-4063-89d9-1fe690669fb9] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:40:58.864746 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-cf66c3c7-96d4-4c41-8906-72ba86ece41f tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:40:58.866143 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-cf66c3c7-96d4-4c41-8906-72ba86ece41f tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:40:58.867186 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-cf66c3c7-96d4-4c41-8906-72ba86ece41f tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:40:58.867935 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-cf66c3c7-96d4-4c41-8906-72ba86ece41f tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:40:58.888072 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG dbcounter [-] [129349] Writing DB stats nova_cell1:SELECT=100 {{(pid=129349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 10:40:59.058840 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-cf66c3c7-96d4-4c41-8906-72ba86ece41f tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d09fe912b4c4cab81b00df801f69680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2496096b374f399606bff9a08b65eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:40:59.068047 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-cf66c3c7-96d4-4c41-8906-72ba86ece41f tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] 10.222.0.42 "GET /compute/v2.1/servers/f835921f-5523-4063-89d9-1fe690669fb9" status: 200 len: 1260 microversion: 2.1 time: 0.220876 Jun 06 10:40:59.077419 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 189/353] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:40:58 2022] GET /compute/v2.1/servers/f835921f-5523-4063-89d9-1fe690669fb9 => generated 1260 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:40:59.174516 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-c9184ce7-756a-4cc5-91ea-2f16f90bff62 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:40:59.175806 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-c9184ce7-756a-4cc5-91ea-2f16f90bff62 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] [instance: 5a0a79a6-8e61-477e-8269-730dfb6d04a6] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:40:59.183117 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-c9184ce7-756a-4cc5-91ea-2f16f90bff62 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:40:59.185973 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-c9184ce7-756a-4cc5-91ea-2f16f90bff62 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:40:59.188529 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-c9184ce7-756a-4cc5-91ea-2f16f90bff62 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:40:59.191405 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-c9184ce7-756a-4cc5-91ea-2f16f90bff62 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:40:59.489154 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-c9184ce7-756a-4cc5-91ea-2f16f90bff62 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:40:59.499576 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-c9184ce7-756a-4cc5-91ea-2f16f90bff62 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:40:59.500670 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-c9184ce7-756a-4cc5-91ea-2f16f90bff62 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:40:59.502029 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-c9184ce7-756a-4cc5-91ea-2f16f90bff62 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0a79a6-8e61-477e-8269-730dfb6d04a6" status: 200 len: 1738 microversion: 2.20 time: 0.331529 Jun 06 10:40:59.503362 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 165/354] 10.222.0.42 () {60 vars in 1276 bytes} [Mon Jun 6 10:40:59 2022] GET /compute/v2.1/servers/5a0a79a6-8e61-477e-8269-730dfb6d04a6 => generated 1738 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 10:40:59.598666 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [req-e376eb11-ff59-4122-8b68-951e5abfaf0e req-7fce24db-0ac8-4e60-8e19-8c9f8d587bd2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f835921f-5523-4063-89d9-1fe690669fb9", "name": "network-vif-plugged", "status": "completed", "tag": "3a3a5f7d-eb2a-4a67-83a6-a0deab7b7e1a"}]} {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 10:40:59.610504 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [req-e376eb11-ff59-4122-8b68-951e5abfaf0e req-7fce24db-0ac8-4e60-8e19-8c9f8d587bd2 service nova] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:40:59.610934 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [req-e376eb11-ff59-4122-8b68-951e5abfaf0e req-7fce24db-0ac8-4e60-8e19-8c9f8d587bd2 service nova] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:40:59.635877 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.compute.server_external_events [req-e376eb11-ff59-4122-8b68-951e5abfaf0e req-7fce24db-0ac8-4e60-8e19-8c9f8d587bd2 service nova] Creating event network-vif-plugged:3a3a5f7d-eb2a-4a67-83a6-a0deab7b7e1a for instance f835921f-5523-4063-89d9-1fe690669fb9 on hv-cinder-84482 Jun 06 10:40:59.649264 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [req-e376eb11-ff59-4122-8b68-951e5abfaf0e req-7fce24db-0ac8-4e60-8e19-8c9f8d587bd2 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053938 Jun 06 10:40:59.660319 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 190/355] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Jun 6 10:40:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 10:41:00.086536 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-41efe9ad-7735-47a5-8740-15387b50df7b tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:41:00.087156 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-41efe9ad-7735-47a5-8740-15387b50df7b tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] [instance: f835921f-5523-4063-89d9-1fe690669fb9] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:41:00.096015 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-41efe9ad-7735-47a5-8740-15387b50df7b tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:41:00.096848 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-41efe9ad-7735-47a5-8740-15387b50df7b tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:41:00.098760 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-41efe9ad-7735-47a5-8740-15387b50df7b tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:41:00.099579 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-41efe9ad-7735-47a5-8740-15387b50df7b tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:41:00.523765 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-dd3a7644-5f34-46f8-adaa-c9ac67959c3e tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:41:00.525105 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-dd3a7644-5f34-46f8-adaa-c9ac67959c3e tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] [instance: 5a0a79a6-8e61-477e-8269-730dfb6d04a6] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:41:00.541825 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-dd3a7644-5f34-46f8-adaa-c9ac67959c3e tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:41:00.544689 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-dd3a7644-5f34-46f8-adaa-c9ac67959c3e tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:41:00.550557 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-dd3a7644-5f34-46f8-adaa-c9ac67959c3e tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:41:00.553969 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-dd3a7644-5f34-46f8-adaa-c9ac67959c3e tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:41:00.759858 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-41efe9ad-7735-47a5-8740-15387b50df7b tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d09fe912b4c4cab81b00df801f69680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2496096b374f399606bff9a08b65eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:41:00.774379 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-41efe9ad-7735-47a5-8740-15387b50df7b tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] 10.222.0.42 "GET /compute/v2.1/servers/f835921f-5523-4063-89d9-1fe690669fb9" status: 200 len: 1260 microversion: 2.1 time: 0.687400 Jun 06 10:41:00.777427 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 166/356] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:41:00 2022] GET /compute/v2.1/servers/f835921f-5523-4063-89d9-1fe690669fb9 => generated 1260 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:41:01.167275 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-dd3a7644-5f34-46f8-adaa-c9ac67959c3e tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:41:01.182661 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-dd3a7644-5f34-46f8-adaa-c9ac67959c3e tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:41:01.187935 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-dd3a7644-5f34-46f8-adaa-c9ac67959c3e tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:41:01.191143 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-dd3a7644-5f34-46f8-adaa-c9ac67959c3e tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0a79a6-8e61-477e-8269-730dfb6d04a6" status: 200 len: 1738 microversion: 2.20 time: 0.670976 Jun 06 10:41:01.192569 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 191/357] 10.222.0.42 () {60 vars in 1276 bytes} [Mon Jun 6 10:41:00 2022] GET /compute/v2.1/servers/5a0a79a6-8e61-477e-8269-730dfb6d04a6 => generated 1738 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 10:41:01.793668 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-ee30793a-72a8-4487-a1ca-0466bf14d9fe tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:41:01.794877 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-ee30793a-72a8-4487-a1ca-0466bf14d9fe tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] [instance: f835921f-5523-4063-89d9-1fe690669fb9] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:41:01.806274 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-ee30793a-72a8-4487-a1ca-0466bf14d9fe tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:41:01.806935 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-ee30793a-72a8-4487-a1ca-0466bf14d9fe tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:41:01.808301 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-ee30793a-72a8-4487-a1ca-0466bf14d9fe tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:41:01.808916 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-ee30793a-72a8-4487-a1ca-0466bf14d9fe tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:41:02.215776 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-5b5b3027-b23f-4eff-a1a0-6d6b362fbe1b tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:41:02.216411 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-5b5b3027-b23f-4eff-a1a0-6d6b362fbe1b tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] [instance: 5a0a79a6-8e61-477e-8269-730dfb6d04a6] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:41:02.229158 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-ee30793a-72a8-4487-a1ca-0466bf14d9fe tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d09fe912b4c4cab81b00df801f69680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2496096b374f399606bff9a08b65eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:41:02.232163 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-5b5b3027-b23f-4eff-a1a0-6d6b362fbe1b tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:41:02.238389 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-5b5b3027-b23f-4eff-a1a0-6d6b362fbe1b tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:41:02.239337 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-5b5b3027-b23f-4eff-a1a0-6d6b362fbe1b tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:41:02.240673 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-5b5b3027-b23f-4eff-a1a0-6d6b362fbe1b tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:41:02.256880 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-ee30793a-72a8-4487-a1ca-0466bf14d9fe tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] 10.222.0.42 "GET /compute/v2.1/servers/f835921f-5523-4063-89d9-1fe690669fb9" status: 200 len: 1260 microversion: 2.1 time: 0.466514 Jun 06 10:41:02.258351 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 167/358] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:41:01 2022] GET /compute/v2.1/servers/f835921f-5523-4063-89d9-1fe690669fb9 => generated 1260 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:41:02.502527 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-5b5b3027-b23f-4eff-a1a0-6d6b362fbe1b tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:41:02.517894 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-5b5b3027-b23f-4eff-a1a0-6d6b362fbe1b tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:41:02.519994 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-5b5b3027-b23f-4eff-a1a0-6d6b362fbe1b tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:41:02.522641 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-5b5b3027-b23f-4eff-a1a0-6d6b362fbe1b tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0a79a6-8e61-477e-8269-730dfb6d04a6" status: 200 len: 1738 microversion: 2.20 time: 0.310724 Jun 06 10:41:02.535167 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 192/359] 10.222.0.42 () {60 vars in 1276 bytes} [Mon Jun 6 10:41:02 2022] GET /compute/v2.1/servers/5a0a79a6-8e61-477e-8269-730dfb6d04a6 => generated 1738 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 10:41:03.276080 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-262dfd7f-7e25-43f7-96cd-8de793eee7c9 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:41:03.277272 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-262dfd7f-7e25-43f7-96cd-8de793eee7c9 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] [instance: f835921f-5523-4063-89d9-1fe690669fb9] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:41:03.289771 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-262dfd7f-7e25-43f7-96cd-8de793eee7c9 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:41:03.291015 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-262dfd7f-7e25-43f7-96cd-8de793eee7c9 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:41:03.294285 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-262dfd7f-7e25-43f7-96cd-8de793eee7c9 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:41:03.295627 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-262dfd7f-7e25-43f7-96cd-8de793eee7c9 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:41:03.540886 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-262dfd7f-7e25-43f7-96cd-8de793eee7c9 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d09fe912b4c4cab81b00df801f69680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2496096b374f399606bff9a08b65eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:41:03.550312 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-082ce6d1-c2a3-4a1b-b069-0569377f85df tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:41:03.550961 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-082ce6d1-c2a3-4a1b-b069-0569377f85df tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] [instance: 5a0a79a6-8e61-477e-8269-730dfb6d04a6] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:41:03.551911 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-262dfd7f-7e25-43f7-96cd-8de793eee7c9 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] 10.222.0.42 "GET /compute/v2.1/servers/f835921f-5523-4063-89d9-1fe690669fb9" status: 200 len: 1444 microversion: 2.1 time: 0.280983 Jun 06 10:41:03.558535 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 168/360] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:41:03 2022] GET /compute/v2.1/servers/f835921f-5523-4063-89d9-1fe690669fb9 => generated 1444 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:41:03.562787 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-082ce6d1-c2a3-4a1b-b069-0569377f85df tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:41:03.563238 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-082ce6d1-c2a3-4a1b-b069-0569377f85df tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:41:03.564352 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-082ce6d1-c2a3-4a1b-b069-0569377f85df tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:41:03.564788 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-082ce6d1-c2a3-4a1b-b069-0569377f85df tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:41:03.568699 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-26de6421-7a35-472d-aa67-d1a7a267aaa2 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:41:03.569926 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-26de6421-7a35-472d-aa67-d1a7a267aaa2 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] [instance: f835921f-5523-4063-89d9-1fe690669fb9] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:41:03.576783 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-26de6421-7a35-472d-aa67-d1a7a267aaa2 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:41:03.577443 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-26de6421-7a35-472d-aa67-d1a7a267aaa2 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:41:03.578365 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-26de6421-7a35-472d-aa67-d1a7a267aaa2 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:41:03.578949 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-26de6421-7a35-472d-aa67-d1a7a267aaa2 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:41:03.832754 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-082ce6d1-c2a3-4a1b-b069-0569377f85df tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:41:03.867795 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-082ce6d1-c2a3-4a1b-b069-0569377f85df tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:41:03.872089 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-082ce6d1-c2a3-4a1b-b069-0569377f85df tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:41:03.873586 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-26de6421-7a35-472d-aa67-d1a7a267aaa2 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d09fe912b4c4cab81b00df801f69680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2496096b374f399606bff9a08b65eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:41:03.875910 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-082ce6d1-c2a3-4a1b-b069-0569377f85df tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0a79a6-8e61-477e-8269-730dfb6d04a6" status: 200 len: 1738 microversion: 2.20 time: 0.338152 Jun 06 10:41:03.877026 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 193/361] 10.222.0.42 () {60 vars in 1276 bytes} [Mon Jun 6 10:41:03 2022] GET /compute/v2.1/servers/5a0a79a6-8e61-477e-8269-730dfb6d04a6 => generated 1738 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 10:41:03.890094 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-26de6421-7a35-472d-aa67-d1a7a267aaa2 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] 10.222.0.42 "GET /compute/v2.1/servers/f835921f-5523-4063-89d9-1fe690669fb9" status: 200 len: 1444 microversion: 2.1 time: 0.325039 Jun 06 10:41:03.906386 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 169/362] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:41:03 2022] GET /compute/v2.1/servers/f835921f-5523-4063-89d9-1fe690669fb9 => generated 1444 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:41:04.897393 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-b50aadd9-c8ff-4258-b3e8-656429cb1945 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:41:04.898068 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-b50aadd9-c8ff-4258-b3e8-656429cb1945 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] [instance: 5a0a79a6-8e61-477e-8269-730dfb6d04a6] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:41:04.908216 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG dbcounter [-] [129349] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=3 {{(pid=129349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 10:41:04.912871 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-b50aadd9-c8ff-4258-b3e8-656429cb1945 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:41:04.915330 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-b50aadd9-c8ff-4258-b3e8-656429cb1945 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:41:04.918153 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-b50aadd9-c8ff-4258-b3e8-656429cb1945 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:41:04.918797 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-b50aadd9-c8ff-4258-b3e8-656429cb1945 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:41:05.277655 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-b50aadd9-c8ff-4258-b3e8-656429cb1945 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:41:05.297657 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-b50aadd9-c8ff-4258-b3e8-656429cb1945 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:41:05.301388 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-b50aadd9-c8ff-4258-b3e8-656429cb1945 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:41:05.305310 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-b50aadd9-c8ff-4258-b3e8-656429cb1945 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0a79a6-8e61-477e-8269-730dfb6d04a6" status: 200 len: 1738 microversion: 2.20 time: 0.411068 Jun 06 10:41:05.306193 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 194/363] 10.222.0.42 () {60 vars in 1276 bytes} [Mon Jun 6 10:41:04 2022] GET /compute/v2.1/servers/5a0a79a6-8e61-477e-8269-730dfb6d04a6 => generated 1738 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 10:41:06.352558 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-708ea96e-e3f1-414b-8b91-53455261eb53 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:41:06.353238 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-708ea96e-e3f1-414b-8b91-53455261eb53 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] [instance: 5a0a79a6-8e61-477e-8269-730dfb6d04a6] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:41:06.361238 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG dbcounter [-] [129350] Writing DB stats nova_api:SELECT=64 {{(pid=129350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 10:41:06.401051 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-708ea96e-e3f1-414b-8b91-53455261eb53 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:41:06.401519 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-708ea96e-e3f1-414b-8b91-53455261eb53 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:41:06.408643 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-708ea96e-e3f1-414b-8b91-53455261eb53 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:41:06.410638 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-708ea96e-e3f1-414b-8b91-53455261eb53 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:41:06.827762 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-708ea96e-e3f1-414b-8b91-53455261eb53 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:41:06.847040 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-708ea96e-e3f1-414b-8b91-53455261eb53 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:41:06.852711 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-708ea96e-e3f1-414b-8b91-53455261eb53 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:41:06.857189 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-708ea96e-e3f1-414b-8b91-53455261eb53 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0a79a6-8e61-477e-8269-730dfb6d04a6" status: 200 len: 1738 microversion: 2.20 time: 0.530339 Jun 06 10:41:06.859413 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 170/364] 10.222.0.42 () {60 vars in 1276 bytes} [Mon Jun 6 10:41:06 2022] GET /compute/v2.1/servers/5a0a79a6-8e61-477e-8269-730dfb6d04a6 => generated 1738 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 10:41:07.363080 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [req-b829eb16-5863-4199-b71b-17b8768f5b00 req-f8b34056-c2b4-4025-99e5-170ed61da54f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f835921f-5523-4063-89d9-1fe690669fb9", "tag": "3a3a5f7d-eb2a-4a67-83a6-a0deab7b7e1a"}]} {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 10:41:07.382475 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [req-b829eb16-5863-4199-b71b-17b8768f5b00 req-f8b34056-c2b4-4025-99e5-170ed61da54f service nova] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:41:07.384744 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [req-b829eb16-5863-4199-b71b-17b8768f5b00 req-f8b34056-c2b4-4025-99e5-170ed61da54f service nova] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:41:07.425520 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.compute.server_external_events [req-b829eb16-5863-4199-b71b-17b8768f5b00 req-f8b34056-c2b4-4025-99e5-170ed61da54f service nova] Creating event network-changed:3a3a5f7d-eb2a-4a67-83a6-a0deab7b7e1a for instance f835921f-5523-4063-89d9-1fe690669fb9 on hv-cinder-84482 Jun 06 10:41:07.433019 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [req-b829eb16-5863-4199-b71b-17b8768f5b00 req-f8b34056-c2b4-4025-99e5-170ed61da54f service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075025 Jun 06 10:41:07.436094 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 195/365] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Jun 6 10:41:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 10:41:07.879543 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-a23f1455-52ee-4c59-bbca-5a7fd8ded4d6 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:41:07.880796 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-a23f1455-52ee-4c59-bbca-5a7fd8ded4d6 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] [instance: 5a0a79a6-8e61-477e-8269-730dfb6d04a6] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:41:07.890456 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-a23f1455-52ee-4c59-bbca-5a7fd8ded4d6 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:41:07.892749 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-a23f1455-52ee-4c59-bbca-5a7fd8ded4d6 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:41:07.895107 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-a23f1455-52ee-4c59-bbca-5a7fd8ded4d6 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:41:07.895738 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-a23f1455-52ee-4c59-bbca-5a7fd8ded4d6 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:41:08.414508 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-a23f1455-52ee-4c59-bbca-5a7fd8ded4d6 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:41:08.422785 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-a23f1455-52ee-4c59-bbca-5a7fd8ded4d6 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:41:08.424421 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-a23f1455-52ee-4c59-bbca-5a7fd8ded4d6 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:41:08.425585 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-a23f1455-52ee-4c59-bbca-5a7fd8ded4d6 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0a79a6-8e61-477e-8269-730dfb6d04a6" status: 200 len: 1738 microversion: 2.20 time: 0.550080 Jun 06 10:41:08.426155 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 171/366] 10.222.0.42 () {60 vars in 1276 bytes} [Mon Jun 6 10:41:07 2022] GET /compute/v2.1/servers/5a0a79a6-8e61-477e-8269-730dfb6d04a6 => generated 1738 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 10:41:09.448109 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-a4433927-c2a6-40e6-8862-d1577aff4bd3 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:41:09.448828 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-a4433927-c2a6-40e6-8862-d1577aff4bd3 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] [instance: 5a0a79a6-8e61-477e-8269-730dfb6d04a6] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:41:09.463390 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-a4433927-c2a6-40e6-8862-d1577aff4bd3 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:41:09.472254 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-a4433927-c2a6-40e6-8862-d1577aff4bd3 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:41:09.473536 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-a4433927-c2a6-40e6-8862-d1577aff4bd3 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:41:09.474160 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-a4433927-c2a6-40e6-8862-d1577aff4bd3 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:41:09.968726 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-a4433927-c2a6-40e6-8862-d1577aff4bd3 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:41:09.980153 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-a4433927-c2a6-40e6-8862-d1577aff4bd3 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:41:09.981694 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-a4433927-c2a6-40e6-8862-d1577aff4bd3 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:41:09.992301 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-a4433927-c2a6-40e6-8862-d1577aff4bd3 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0a79a6-8e61-477e-8269-730dfb6d04a6" status: 200 len: 1738 microversion: 2.20 time: 0.539935 Jun 06 10:41:09.993107 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 196/367] 10.222.0.42 () {60 vars in 1276 bytes} [Mon Jun 6 10:41:09 2022] GET /compute/v2.1/servers/5a0a79a6-8e61-477e-8269-730dfb6d04a6 => generated 1738 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 10:41:11.013261 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-3df759ff-dc3f-4041-a687-0217d4e0a15c tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:41:11.014599 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-3df759ff-dc3f-4041-a687-0217d4e0a15c tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] [instance: 5a0a79a6-8e61-477e-8269-730dfb6d04a6] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:41:11.028442 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-3df759ff-dc3f-4041-a687-0217d4e0a15c tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:41:11.028918 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-3df759ff-dc3f-4041-a687-0217d4e0a15c tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:41:11.029736 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-3df759ff-dc3f-4041-a687-0217d4e0a15c tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:41:11.030169 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-3df759ff-dc3f-4041-a687-0217d4e0a15c tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:41:11.282690 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-3df759ff-dc3f-4041-a687-0217d4e0a15c tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:41:11.292607 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-3df759ff-dc3f-4041-a687-0217d4e0a15c tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:41:11.294538 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-3df759ff-dc3f-4041-a687-0217d4e0a15c tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:41:11.296379 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-3df759ff-dc3f-4041-a687-0217d4e0a15c tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0a79a6-8e61-477e-8269-730dfb6d04a6" status: 200 len: 1738 microversion: 2.20 time: 0.289030 Jun 06 10:41:11.297190 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 172/368] 10.222.0.42 () {60 vars in 1276 bytes} [Mon Jun 6 10:41:11 2022] GET /compute/v2.1/servers/5a0a79a6-8e61-477e-8269-730dfb6d04a6 => generated 1738 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 10:41:12.322370 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-cc38df03-aa4f-42fe-a775-73d0a32a25b2 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:41:12.323590 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-cc38df03-aa4f-42fe-a775-73d0a32a25b2 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] [instance: 5a0a79a6-8e61-477e-8269-730dfb6d04a6] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:41:12.337993 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-cc38df03-aa4f-42fe-a775-73d0a32a25b2 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:41:12.338791 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-cc38df03-aa4f-42fe-a775-73d0a32a25b2 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:41:12.340053 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-cc38df03-aa4f-42fe-a775-73d0a32a25b2 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:41:12.341009 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-cc38df03-aa4f-42fe-a775-73d0a32a25b2 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:41:12.679509 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-cc38df03-aa4f-42fe-a775-73d0a32a25b2 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:41:12.690965 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-cc38df03-aa4f-42fe-a775-73d0a32a25b2 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:41:12.692522 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-cc38df03-aa4f-42fe-a775-73d0a32a25b2 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:41:12.694727 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-cc38df03-aa4f-42fe-a775-73d0a32a25b2 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0a79a6-8e61-477e-8269-730dfb6d04a6" status: 200 len: 1738 microversion: 2.20 time: 0.377763 Jun 06 10:41:12.696081 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 197/369] 10.222.0.42 () {60 vars in 1276 bytes} [Mon Jun 6 10:41:12 2022] GET /compute/v2.1/servers/5a0a79a6-8e61-477e-8269-730dfb6d04a6 => generated 1738 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 10:41:13.713239 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-220b56dc-43f0-4e14-be00-7772e7c05765 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:41:13.716676 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-220b56dc-43f0-4e14-be00-7772e7c05765 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] [instance: 5a0a79a6-8e61-477e-8269-730dfb6d04a6] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:41:13.724784 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-220b56dc-43f0-4e14-be00-7772e7c05765 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:41:13.725477 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-220b56dc-43f0-4e14-be00-7772e7c05765 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:41:13.726709 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-220b56dc-43f0-4e14-be00-7772e7c05765 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:41:13.727313 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-220b56dc-43f0-4e14-be00-7772e7c05765 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:41:14.088861 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-220b56dc-43f0-4e14-be00-7772e7c05765 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:41:14.097809 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-220b56dc-43f0-4e14-be00-7772e7c05765 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:41:14.104271 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-220b56dc-43f0-4e14-be00-7772e7c05765 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:41:14.105755 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-220b56dc-43f0-4e14-be00-7772e7c05765 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0a79a6-8e61-477e-8269-730dfb6d04a6" status: 200 len: 1720 microversion: 2.20 time: 0.397175 Jun 06 10:41:14.106471 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 173/370] 10.222.0.42 () {60 vars in 1276 bytes} [Mon Jun 6 10:41:13 2022] GET /compute/v2.1/servers/5a0a79a6-8e61-477e-8269-730dfb6d04a6 => generated 1720 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 10:41:15.128374 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-799a61be-cf74-4bed-805e-e2a8f0621b96 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:41:15.129665 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-799a61be-cf74-4bed-805e-e2a8f0621b96 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] [instance: 5a0a79a6-8e61-477e-8269-730dfb6d04a6] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:41:15.137508 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-799a61be-cf74-4bed-805e-e2a8f0621b96 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:41:15.138387 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-799a61be-cf74-4bed-805e-e2a8f0621b96 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:41:15.139378 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-799a61be-cf74-4bed-805e-e2a8f0621b96 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:41:15.140036 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-799a61be-cf74-4bed-805e-e2a8f0621b96 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:41:15.311613 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-799a61be-cf74-4bed-805e-e2a8f0621b96 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:41:15.321706 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-799a61be-cf74-4bed-805e-e2a8f0621b96 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:41:15.323340 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-799a61be-cf74-4bed-805e-e2a8f0621b96 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:41:15.324609 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-799a61be-cf74-4bed-805e-e2a8f0621b96 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0a79a6-8e61-477e-8269-730dfb6d04a6" status: 200 len: 1720 microversion: 2.20 time: 0.203559 Jun 06 10:41:15.325763 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 198/371] 10.222.0.42 () {60 vars in 1276 bytes} [Mon Jun 6 10:41:15 2022] GET /compute/v2.1/servers/5a0a79a6-8e61-477e-8269-730dfb6d04a6 => generated 1720 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 10:41:16.351093 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-2009e857-77e9-4923-a2ff-1a2433bbe901 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:41:16.352410 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-2009e857-77e9-4923-a2ff-1a2433bbe901 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] [instance: 5a0a79a6-8e61-477e-8269-730dfb6d04a6] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:41:16.390047 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-2009e857-77e9-4923-a2ff-1a2433bbe901 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:41:16.392454 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-2009e857-77e9-4923-a2ff-1a2433bbe901 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:41:16.399963 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-2009e857-77e9-4923-a2ff-1a2433bbe901 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:41:16.399963 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-2009e857-77e9-4923-a2ff-1a2433bbe901 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:41:16.665876 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-2009e857-77e9-4923-a2ff-1a2433bbe901 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:41:16.675001 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-2009e857-77e9-4923-a2ff-1a2433bbe901 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:41:16.676566 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-2009e857-77e9-4923-a2ff-1a2433bbe901 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:41:16.678583 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-2009e857-77e9-4923-a2ff-1a2433bbe901 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0a79a6-8e61-477e-8269-730dfb6d04a6" status: 200 len: 1723 microversion: 2.20 time: 0.332566 Jun 06 10:41:16.691348 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 174/372] 10.222.0.42 () {60 vars in 1276 bytes} [Mon Jun 6 10:41:16 2022] GET /compute/v2.1/servers/5a0a79a6-8e61-477e-8269-730dfb6d04a6 => generated 1723 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 10:41:16.697591 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-5187014d-3349-4fbb-ac72-0b31ab71bc15 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "44a4c5d1-1257-4bd7-aa88-491f396d04cb"}} {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 10:41:16.698663 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-5187014d-3349-4fbb-ac72-0b31ab71bc15 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] [instance: 5a0a79a6-8e61-477e-8269-730dfb6d04a6] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:41:16.705543 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-5187014d-3349-4fbb-ac72-0b31ab71bc15 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:41:16.706270 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-5187014d-3349-4fbb-ac72-0b31ab71bc15 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:41:16.707391 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-5187014d-3349-4fbb-ac72-0b31ab71bc15 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:41:16.708003 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-5187014d-3349-4fbb-ac72-0b31ab71bc15 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:41:17.144507 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-5187014d-3349-4fbb-ac72-0b31ab71bc15 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] 10.222.0.42 "POST /compute/v2.1/servers/5a0a79a6-8e61-477e-8269-730dfb6d04a6/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.450972 Jun 06 10:41:17.145662 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 199/373] 10.222.0.42 () {62 vars in 1363 bytes} [Mon Jun 6 10:41:16 2022] POST /compute/v2.1/servers/5a0a79a6-8e61-477e-8269-730dfb6d04a6/os-volume_attachments => generated 188 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 06 10:41:17.297569 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-a00706f4-1402-4777-a2a5-c34105213b83 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 10:41:17.298416 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-a00706f4-1402-4777-a2a5-c34105213b83 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] [instance: 5a0a79a6-8e61-477e-8269-730dfb6d04a6] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:41:17.311429 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-a00706f4-1402-4777-a2a5-c34105213b83 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:41:17.312205 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-a00706f4-1402-4777-a2a5-c34105213b83 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:41:17.313226 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-a00706f4-1402-4777-a2a5-c34105213b83 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:41:17.313870 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-a00706f4-1402-4777-a2a5-c34105213b83 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:41:17.452957 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-a00706f4-1402-4777-a2a5-c34105213b83 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] 10.222.0.42 "POST /compute/v2.1/servers/5a0a79a6-8e61-477e-8269-730dfb6d04a6/action" status: 202 len: 0 microversion: 2.20 time: 0.159440 Jun 06 10:41:17.462102 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-c69bccbc-edff-43bc-852b-7d6cd2af9d7c tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:41:17.462725 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-c69bccbc-edff-43bc-852b-7d6cd2af9d7c tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] [instance: 5a0a79a6-8e61-477e-8269-730dfb6d04a6] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:41:17.471976 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 175/374] 10.222.0.42 () {62 vars in 1318 bytes} [Mon Jun 6 10:41:17 2022] POST /compute/v2.1/servers/5a0a79a6-8e61-477e-8269-730dfb6d04a6/action => generated 0 bytes in 179 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 06 10:41:17.480992 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-c69bccbc-edff-43bc-852b-7d6cd2af9d7c tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:41:17.481712 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-c69bccbc-edff-43bc-852b-7d6cd2af9d7c tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:41:17.482665 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-c69bccbc-edff-43bc-852b-7d6cd2af9d7c tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:41:17.483263 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-c69bccbc-edff-43bc-852b-7d6cd2af9d7c tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:41:17.595669 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [req-43bcee70-4294-4ad3-8cd7-04b1f3c17c1f req-3a2e8a29-02b7-4a67-97dc-8cb656f16814 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a0a79a6-8e61-477e-8269-730dfb6d04a6", "name": "network-vif-unplugged", "status": "completed", "tag": "581fdfa4-6fbc-445e-ad43-e4ef71127c0e"}]} {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 10:41:17.626046 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [req-43bcee70-4294-4ad3-8cd7-04b1f3c17c1f req-3a2e8a29-02b7-4a67-97dc-8cb656f16814 service nova] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:41:17.626492 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [req-43bcee70-4294-4ad3-8cd7-04b1f3c17c1f req-3a2e8a29-02b7-4a67-97dc-8cb656f16814 service nova] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:41:17.667415 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.compute.server_external_events [req-43bcee70-4294-4ad3-8cd7-04b1f3c17c1f req-3a2e8a29-02b7-4a67-97dc-8cb656f16814 service nova] Unable to find a host for instance 5a0a79a6-8e61-477e-8269-730dfb6d04a6. Dropping event network-vif-unplugged {{(pid=129350) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jun 06 10:41:17.675214 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [req-43bcee70-4294-4ad3-8cd7-04b1f3c17c1f req-3a2e8a29-02b7-4a67-97dc-8cb656f16814 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.083966 Jun 06 10:41:17.678468 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 176/375] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Jun 6 10:41:17 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 88 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jun 06 10:41:17.740603 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-c69bccbc-edff-43bc-852b-7d6cd2af9d7c tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:41:17.753638 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-c69bccbc-edff-43bc-852b-7d6cd2af9d7c tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:41:17.756448 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-c69bccbc-edff-43bc-852b-7d6cd2af9d7c tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:41:17.758014 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-c69bccbc-edff-43bc-852b-7d6cd2af9d7c tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0a79a6-8e61-477e-8269-730dfb6d04a6" status: 200 len: 1749 microversion: 2.20 time: 0.300287 Jun 06 10:41:17.759245 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 200/376] 10.222.0.42 () {60 vars in 1276 bytes} [Mon Jun 6 10:41:17 2022] GET /compute/v2.1/servers/5a0a79a6-8e61-477e-8269-730dfb6d04a6 => generated 1749 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 06 10:41:18.779366 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-601d725f-699f-4346-b3d7-99f994810514 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:41:18.780874 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-601d725f-699f-4346-b3d7-99f994810514 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] [instance: 5a0a79a6-8e61-477e-8269-730dfb6d04a6] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:41:18.801260 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-601d725f-699f-4346-b3d7-99f994810514 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:41:18.807581 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-601d725f-699f-4346-b3d7-99f994810514 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:41:18.808707 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-601d725f-699f-4346-b3d7-99f994810514 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:41:18.809315 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-601d725f-699f-4346-b3d7-99f994810514 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:41:19.015959 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-601d725f-699f-4346-b3d7-99f994810514 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:41:19.026488 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-601d725f-699f-4346-b3d7-99f994810514 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:41:19.028140 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-601d725f-699f-4346-b3d7-99f994810514 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:41:19.029425 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-601d725f-699f-4346-b3d7-99f994810514 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0a79a6-8e61-477e-8269-730dfb6d04a6" status: 200 len: 1751 microversion: 2.20 time: 0.254702 Jun 06 10:41:19.032275 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 177/377] 10.222.0.42 () {60 vars in 1276 bytes} [Mon Jun 6 10:41:18 2022] GET /compute/v2.1/servers/5a0a79a6-8e61-477e-8269-730dfb6d04a6 => generated 1751 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 10:41:20.055998 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-c1b2f411-402b-431d-9be0-524385919811 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:41:20.057325 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-c1b2f411-402b-431d-9be0-524385919811 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] [instance: 5a0a79a6-8e61-477e-8269-730dfb6d04a6] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:41:20.068175 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-c1b2f411-402b-431d-9be0-524385919811 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:41:20.071862 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-c1b2f411-402b-431d-9be0-524385919811 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:41:20.072860 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-c1b2f411-402b-431d-9be0-524385919811 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:41:20.073456 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-c1b2f411-402b-431d-9be0-524385919811 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:41:20.371970 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-c1b2f411-402b-431d-9be0-524385919811 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:41:20.388429 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-c1b2f411-402b-431d-9be0-524385919811 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:41:20.392050 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-c1b2f411-402b-431d-9be0-524385919811 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:41:20.394460 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-c1b2f411-402b-431d-9be0-524385919811 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0a79a6-8e61-477e-8269-730dfb6d04a6" status: 200 len: 1807 microversion: 2.20 time: 0.342408 Jun 06 10:41:20.404295 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 201/378] 10.222.0.42 () {60 vars in 1276 bytes} [Mon Jun 6 10:41:20 2022] GET /compute/v2.1/servers/5a0a79a6-8e61-477e-8269-730dfb6d04a6 => generated 1807 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 10:41:21.415591 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-32b00344-f89e-4d4c-a004-875a93c3b452 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:41:21.416217 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-32b00344-f89e-4d4c-a004-875a93c3b452 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] [instance: 5a0a79a6-8e61-477e-8269-730dfb6d04a6] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:41:21.423024 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-32b00344-f89e-4d4c-a004-875a93c3b452 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:41:21.436531 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-32b00344-f89e-4d4c-a004-875a93c3b452 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:41:21.437390 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-32b00344-f89e-4d4c-a004-875a93c3b452 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:41:21.437950 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-32b00344-f89e-4d4c-a004-875a93c3b452 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:41:21.621453 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-32b00344-f89e-4d4c-a004-875a93c3b452 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:41:21.633146 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-32b00344-f89e-4d4c-a004-875a93c3b452 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:41:21.635046 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-32b00344-f89e-4d4c-a004-875a93c3b452 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:41:21.636676 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-32b00344-f89e-4d4c-a004-875a93c3b452 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0a79a6-8e61-477e-8269-730dfb6d04a6" status: 200 len: 1807 microversion: 2.20 time: 0.226301 Jun 06 10:41:21.650574 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 178/379] 10.222.0.42 () {60 vars in 1276 bytes} [Mon Jun 6 10:41:21 2022] GET /compute/v2.1/servers/5a0a79a6-8e61-477e-8269-730dfb6d04a6 => generated 1807 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 10:41:21.654226 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-394e57b2-06d1-4783-8728-d8503ee81b27 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a552af91-4f0b-475b-bfbb-1078f971dd78"}} {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 10:41:21.655564 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-394e57b2-06d1-4783-8728-d8503ee81b27 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] [instance: d4d7ae82-4a52-4e0e-87b5-13a5b95cc3a0] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:41:21.669152 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-394e57b2-06d1-4783-8728-d8503ee81b27 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:41:21.670448 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-394e57b2-06d1-4783-8728-d8503ee81b27 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:41:21.671822 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-394e57b2-06d1-4783-8728-d8503ee81b27 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:41:21.673481 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-394e57b2-06d1-4783-8728-d8503ee81b27 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:41:22.663546 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-91cfd2f6-ea06-405a-8d6c-a8655a1cd13c tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:41:22.665795 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-91cfd2f6-ea06-405a-8d6c-a8655a1cd13c tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] [instance: 5a0a79a6-8e61-477e-8269-730dfb6d04a6] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:41:22.674756 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-91cfd2f6-ea06-405a-8d6c-a8655a1cd13c tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:41:22.676157 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-91cfd2f6-ea06-405a-8d6c-a8655a1cd13c tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:41:22.678090 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-91cfd2f6-ea06-405a-8d6c-a8655a1cd13c tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:41:22.678825 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-91cfd2f6-ea06-405a-8d6c-a8655a1cd13c tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:41:22.907717 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-91cfd2f6-ea06-405a-8d6c-a8655a1cd13c tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:41:22.924544 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-91cfd2f6-ea06-405a-8d6c-a8655a1cd13c tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:41:22.926103 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-91cfd2f6-ea06-405a-8d6c-a8655a1cd13c tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:41:22.927369 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-91cfd2f6-ea06-405a-8d6c-a8655a1cd13c tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0a79a6-8e61-477e-8269-730dfb6d04a6" status: 200 len: 1807 microversion: 2.20 time: 0.274312 Jun 06 10:41:22.956724 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 179/380] 10.222.0.42 () {60 vars in 1276 bytes} [Mon Jun 6 10:41:22 2022] GET /compute/v2.1/servers/5a0a79a6-8e61-477e-8269-730dfb6d04a6 => generated 1807 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 06 10:41:23.151547 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-394e57b2-06d1-4783-8728-d8503ee81b27 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] 10.222.0.42 "POST /compute/v2.1/servers/d4d7ae82-4a52-4e0e-87b5-13a5b95cc3a0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.505641 Jun 06 10:41:23.171151 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 202/381] 10.222.0.42 () {60 vars in 1322 bytes} [Mon Jun 6 10:41:21 2022] POST /compute/v2.1/servers/d4d7ae82-4a52-4e0e-87b5-13a5b95cc3a0/os-volume_attachments => generated 194 bytes in 1526 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 10:41:23.568386 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-0a119ba7-8d45-4d9a-9b5c-4c3adb81af86 tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Action: 'create', calling method: .version_select at 0x7f8fd82c5670>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-879768701", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBdxdwMc2SpB/bPsx6VyhlI6bDhzAl0ManQROm3wFlZNB91ySqK2lm4SrELh6XSYY+Nz7QeLPu42esckwkfYkOj7a6YZC901CgBVGWtFvWC/2a/bLJ15BkTjtGJZF0dl9w=="}} {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 10:41:23.585294 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.quota [None req-0a119ba7-8d45-4d9a-9b5c-4c3adb81af86 tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Getting quotas for project 645eadf589944a24bf6e27326a61952c. Resources: {'key_pairs'} {{(pid=129350) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 06 10:41:23.590464 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.quota [None req-0a119ba7-8d45-4d9a-9b5c-4c3adb81af86 tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Getting quotas for user b7b11ed004fc4ef3a1f1c48adf31fe8e and project 645eadf589944a24bf6e27326a61952c. Resources: {'key_pairs'} {{(pid=129350) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 06 10:41:23.614910 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-0a119ba7-8d45-4d9a-9b5c-4c3adb81af86 tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.050697 Jun 06 10:41:23.615503 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 180/382] 10.222.0.42 () {60 vars in 1158 bytes} [Mon Jun 6 10:41:23 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 10:41:23.670136 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-40d56cba-1b05-45c6-ada8-5d154aa490e5 tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-525001991", "imageRef": "ae5ddf90-fc64-4126-a458-0f52e207e49f", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-879768701", "networks": [{"uuid": "27440f68-4bea-4e28-9028-9c10f0c754c3"}]}} {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 10:41:23.728396 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.network.neutron [None req-40d56cba-1b05-45c6-ada8-5d154aa490e5 tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] validate_networks() for [('27440f68-4bea-4e28-9028-9c10f0c754c3', None, None, None, None, None)] {{(pid=129349) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 06 10:41:23.950445 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-c04ea353-19fb-4235-bdc1-43c930d63a13 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:41:23.951676 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-c04ea353-19fb-4235-bdc1-43c930d63a13 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] [instance: 5a0a79a6-8e61-477e-8269-730dfb6d04a6] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:41:23.958972 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-c04ea353-19fb-4235-bdc1-43c930d63a13 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:41:23.959505 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-c04ea353-19fb-4235-bdc1-43c930d63a13 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:41:23.960303 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-c04ea353-19fb-4235-bdc1-43c930d63a13 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:41:23.960731 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-c04ea353-19fb-4235-bdc1-43c930d63a13 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:41:23.963376 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG dbcounter [-] [129350] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 10:41:24.194118 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-c04ea353-19fb-4235-bdc1-43c930d63a13 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:41:24.205144 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-c04ea353-19fb-4235-bdc1-43c930d63a13 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:41:24.206676 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-c04ea353-19fb-4235-bdc1-43c930d63a13 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:41:24.207920 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-c04ea353-19fb-4235-bdc1-43c930d63a13 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0a79a6-8e61-477e-8269-730dfb6d04a6" status: 200 len: 1807 microversion: 2.20 time: 0.261249 Jun 06 10:41:24.208487 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 181/383] 10.222.0.42 () {60 vars in 1276 bytes} [Mon Jun 6 10:41:23 2022] GET /compute/v2.1/servers/5a0a79a6-8e61-477e-8269-730dfb6d04a6 => generated 1807 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 06 10:41:24.233999 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.virt.hardware [None req-40d56cba-1b05-45c6-ada8-5d154aa490e5 tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Flavor limits 0:0:0 {{(pid=129349) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 06 10:41:24.234710 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.virt.hardware [None req-40d56cba-1b05-45c6-ada8-5d154aa490e5 tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Image limits 0:0:0 {{(pid=129349) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 06 10:41:24.235307 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.virt.hardware [None req-40d56cba-1b05-45c6-ada8-5d154aa490e5 tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Flavor pref 0:0:0 {{(pid=129349) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 06 10:41:24.235893 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.virt.hardware [None req-40d56cba-1b05-45c6-ada8-5d154aa490e5 tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Image pref 0:0:0 {{(pid=129349) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 06 10:41:24.236293 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.virt.hardware [None req-40d56cba-1b05-45c6-ada8-5d154aa490e5 tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129349) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 06 10:41:24.247037 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-40d56cba-1b05-45c6-ada8-5d154aa490e5 tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:41:24.247836 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-40d56cba-1b05-45c6-ada8-5d154aa490e5 tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:41:24.248891 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-40d56cba-1b05-45c6-ada8-5d154aa490e5 tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:41:24.249518 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-40d56cba-1b05-45c6-ada8-5d154aa490e5 tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:41:24.279902 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.quota [None req-40d56cba-1b05-45c6-ada8-5d154aa490e5 tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Getting quotas for project 645eadf589944a24bf6e27326a61952c. Resources: {'ram', 'cores', 'instances'} {{(pid=129349) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 06 10:41:24.284126 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.quota [None req-40d56cba-1b05-45c6-ada8-5d154aa490e5 tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Getting quotas for user b7b11ed004fc4ef3a1f1c48adf31fe8e and project 645eadf589944a24bf6e27326a61952c. Resources: {'ram', 'cores', 'instances'} {{(pid=129349) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 06 10:41:24.303029 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-40d56cba-1b05-45c6-ada8-5d154aa490e5 tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Going to run 1 instances... {{(pid=129349) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 06 10:41:24.305486 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-40d56cba-1b05-45c6-ada8-5d154aa490e5 tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] [instance: 8e9cb9c1-7df9-4cb7-9121-54bf74f552c7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ae5ddf90-fc64-4126-a458-0f52e207e49f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129349) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 06 10:41:24.374238 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-40d56cba-1b05-45c6-ada8-5d154aa490e5 tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.708457 Jun 06 10:41:24.374985 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 203/384] 10.222.0.42 () {60 vars in 1146 bytes} [Mon Jun 6 10:41:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 710 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 06 10:41:24.386135 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-384df234-0bff-45be-ba63-15113e1631e2 tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:41:24.386839 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-384df234-0bff-45be-ba63-15113e1631e2 tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] [instance: 8e9cb9c1-7df9-4cb7-9121-54bf74f552c7] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:41:24.461778 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-384df234-0bff-45be-ba63-15113e1631e2 tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7b11ed004fc4ef3a1f1c48adf31fe8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '645eadf589944a24bf6e27326a61952c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:41:24.469976 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-384df234-0bff-45be-ba63-15113e1631e2 tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] 10.222.0.42 "GET /compute/v2.1/servers/8e9cb9c1-7df9-4cb7-9121-54bf74f552c7" status: 200 len: 1257 microversion: 2.1 time: 0.087800 Jun 06 10:41:24.470871 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 182/385] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:41:24 2022] GET /compute/v2.1/servers/8e9cb9c1-7df9-4cb7-9121-54bf74f552c7 => generated 1257 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:41:25.226998 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-61722801-37d3-4787-b0be-b9b28971f806 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:41:25.227618 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-61722801-37d3-4787-b0be-b9b28971f806 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] [instance: 5a0a79a6-8e61-477e-8269-730dfb6d04a6] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:41:25.234599 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-61722801-37d3-4787-b0be-b9b28971f806 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:41:25.235205 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-61722801-37d3-4787-b0be-b9b28971f806 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:41:25.235826 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-61722801-37d3-4787-b0be-b9b28971f806 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:41:25.236272 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-61722801-37d3-4787-b0be-b9b28971f806 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:41:25.240888 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG dbcounter [-] [129349] Writing DB stats nova_cell1:SELECT=90,nova_cell1:INSERT=4,nova_cell1:UPDATE=6 {{(pid=129349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 10:41:25.398877 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-61722801-37d3-4787-b0be-b9b28971f806 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:41:25.407756 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-61722801-37d3-4787-b0be-b9b28971f806 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:41:25.409420 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-61722801-37d3-4787-b0be-b9b28971f806 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:41:25.410671 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-61722801-37d3-4787-b0be-b9b28971f806 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0a79a6-8e61-477e-8269-730dfb6d04a6" status: 200 len: 1807 microversion: 2.20 time: 0.188120 Jun 06 10:41:25.411990 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 204/386] 10.222.0.42 () {60 vars in 1276 bytes} [Mon Jun 6 10:41:25 2022] GET /compute/v2.1/servers/5a0a79a6-8e61-477e-8269-730dfb6d04a6 => generated 1807 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 06 10:41:25.487581 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-a185322d-698a-4e8d-bec9-5714bd2d2986 tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:41:25.488202 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-a185322d-698a-4e8d-bec9-5714bd2d2986 tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] [instance: 8e9cb9c1-7df9-4cb7-9121-54bf74f552c7] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:41:25.496058 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-a185322d-698a-4e8d-bec9-5714bd2d2986 tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:41:25.496489 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-a185322d-698a-4e8d-bec9-5714bd2d2986 tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:41:25.497262 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-a185322d-698a-4e8d-bec9-5714bd2d2986 tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:41:25.497719 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-a185322d-698a-4e8d-bec9-5714bd2d2986 tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:41:25.561146 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-a185322d-698a-4e8d-bec9-5714bd2d2986 tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7b11ed004fc4ef3a1f1c48adf31fe8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '645eadf589944a24bf6e27326a61952c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:41:25.569641 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-a185322d-698a-4e8d-bec9-5714bd2d2986 tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] 10.222.0.42 "GET /compute/v2.1/servers/8e9cb9c1-7df9-4cb7-9121-54bf74f552c7" status: 200 len: 1261 microversion: 2.1 time: 0.085828 Jun 06 10:41:25.570220 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 183/387] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:41:25 2022] GET /compute/v2.1/servers/8e9cb9c1-7df9-4cb7-9121-54bf74f552c7 => generated 1261 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:41:26.429728 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-8a9a89bc-037f-4232-8960-fac48a999e11 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:41:26.431201 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-8a9a89bc-037f-4232-8960-fac48a999e11 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] [instance: 5a0a79a6-8e61-477e-8269-730dfb6d04a6] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:41:26.438067 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-8a9a89bc-037f-4232-8960-fac48a999e11 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:41:26.438583 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-8a9a89bc-037f-4232-8960-fac48a999e11 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:41:26.439427 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-8a9a89bc-037f-4232-8960-fac48a999e11 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:41:26.439951 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-8a9a89bc-037f-4232-8960-fac48a999e11 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:41:26.583302 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-8a9a89bc-037f-4232-8960-fac48a999e11 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:41:26.586455 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-f6e67ef9-0111-4883-ae54-85af3bd848c6 tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:41:26.587664 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-f6e67ef9-0111-4883-ae54-85af3bd848c6 tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] [instance: 8e9cb9c1-7df9-4cb7-9121-54bf74f552c7] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:41:26.592433 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-8a9a89bc-037f-4232-8960-fac48a999e11 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:41:26.594034 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-8a9a89bc-037f-4232-8960-fac48a999e11 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:41:26.594324 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-f6e67ef9-0111-4883-ae54-85af3bd848c6 tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:41:26.594759 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-f6e67ef9-0111-4883-ae54-85af3bd848c6 tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:41:26.595426 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-8a9a89bc-037f-4232-8960-fac48a999e11 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0a79a6-8e61-477e-8269-730dfb6d04a6" status: 200 len: 1807 microversion: 2.20 time: 0.169949 Jun 06 10:41:26.595550 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-f6e67ef9-0111-4883-ae54-85af3bd848c6 tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:41:26.596110 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-f6e67ef9-0111-4883-ae54-85af3bd848c6 tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:41:26.596498 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 205/388] 10.222.0.42 () {60 vars in 1276 bytes} [Mon Jun 6 10:41:26 2022] GET /compute/v2.1/servers/5a0a79a6-8e61-477e-8269-730dfb6d04a6 => generated 1807 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 10:41:26.664312 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-f6e67ef9-0111-4883-ae54-85af3bd848c6 tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7b11ed004fc4ef3a1f1c48adf31fe8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '645eadf589944a24bf6e27326a61952c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:41:26.672300 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-f6e67ef9-0111-4883-ae54-85af3bd848c6 tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] 10.222.0.42 "GET /compute/v2.1/servers/8e9cb9c1-7df9-4cb7-9121-54bf74f552c7" status: 200 len: 1261 microversion: 2.1 time: 0.090241 Jun 06 10:41:26.672870 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 184/389] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:41:26 2022] GET /compute/v2.1/servers/8e9cb9c1-7df9-4cb7-9121-54bf74f552c7 => generated 1261 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:41:27.614136 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-7345f407-4637-4d78-a5cd-c4aa6bc7b5dd tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:41:27.615573 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-7345f407-4637-4d78-a5cd-c4aa6bc7b5dd tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] [instance: 5a0a79a6-8e61-477e-8269-730dfb6d04a6] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:41:27.622580 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-7345f407-4637-4d78-a5cd-c4aa6bc7b5dd tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:41:27.623158 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-7345f407-4637-4d78-a5cd-c4aa6bc7b5dd tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:41:27.624071 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-7345f407-4637-4d78-a5cd-c4aa6bc7b5dd tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:41:27.624599 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-7345f407-4637-4d78-a5cd-c4aa6bc7b5dd tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:41:27.689426 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-71f0bd1a-f5a5-4bbc-be65-7a400cb1addf tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:41:27.690047 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-71f0bd1a-f5a5-4bbc-be65-7a400cb1addf tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] [instance: 8e9cb9c1-7df9-4cb7-9121-54bf74f552c7] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:41:27.697438 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-71f0bd1a-f5a5-4bbc-be65-7a400cb1addf tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:41:27.698156 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-71f0bd1a-f5a5-4bbc-be65-7a400cb1addf tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:41:27.699089 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-71f0bd1a-f5a5-4bbc-be65-7a400cb1addf tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:41:27.699676 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-71f0bd1a-f5a5-4bbc-be65-7a400cb1addf tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:41:27.791982 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-71f0bd1a-f5a5-4bbc-be65-7a400cb1addf tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7b11ed004fc4ef3a1f1c48adf31fe8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '645eadf589944a24bf6e27326a61952c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:41:27.799457 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-71f0bd1a-f5a5-4bbc-be65-7a400cb1addf tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] 10.222.0.42 "GET /compute/v2.1/servers/8e9cb9c1-7df9-4cb7-9121-54bf74f552c7" status: 200 len: 1261 microversion: 2.1 time: 0.113835 Jun 06 10:41:27.800054 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 185/390] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:41:27 2022] GET /compute/v2.1/servers/8e9cb9c1-7df9-4cb7-9121-54bf74f552c7 => generated 1261 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 10:41:27.803536 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-7345f407-4637-4d78-a5cd-c4aa6bc7b5dd tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:41:27.812334 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-7345f407-4637-4d78-a5cd-c4aa6bc7b5dd tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:41:27.813834 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-7345f407-4637-4d78-a5cd-c4aa6bc7b5dd tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:41:27.814992 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-7345f407-4637-4d78-a5cd-c4aa6bc7b5dd tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0a79a6-8e61-477e-8269-730dfb6d04a6" status: 200 len: 1807 microversion: 2.20 time: 0.204755 Jun 06 10:41:27.817726 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 206/391] 10.222.0.42 () {60 vars in 1276 bytes} [Mon Jun 6 10:41:27 2022] GET /compute/v2.1/servers/5a0a79a6-8e61-477e-8269-730dfb6d04a6 => generated 1807 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 10:41:28.815610 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-b46fd213-dab1-44ac-928d-9420fefaa767 tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:41:28.816291 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-b46fd213-dab1-44ac-928d-9420fefaa767 tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] [instance: 8e9cb9c1-7df9-4cb7-9121-54bf74f552c7] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:41:28.823304 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-b46fd213-dab1-44ac-928d-9420fefaa767 tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:41:28.823756 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-b46fd213-dab1-44ac-928d-9420fefaa767 tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:41:28.824614 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-b46fd213-dab1-44ac-928d-9420fefaa767 tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:41:28.825053 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-b46fd213-dab1-44ac-928d-9420fefaa767 tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:41:28.834068 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-5558b95d-f1a7-4e9b-8909-dfbb45441b29 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:41:28.835415 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-5558b95d-f1a7-4e9b-8909-dfbb45441b29 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] [instance: 5a0a79a6-8e61-477e-8269-730dfb6d04a6] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:41:28.842313 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-5558b95d-f1a7-4e9b-8909-dfbb45441b29 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:41:28.843081 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-5558b95d-f1a7-4e9b-8909-dfbb45441b29 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:41:28.844128 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-5558b95d-f1a7-4e9b-8909-dfbb45441b29 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:41:28.844774 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-5558b95d-f1a7-4e9b-8909-dfbb45441b29 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:41:28.898077 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-b46fd213-dab1-44ac-928d-9420fefaa767 tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7b11ed004fc4ef3a1f1c48adf31fe8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '645eadf589944a24bf6e27326a61952c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:41:28.907221 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-b46fd213-dab1-44ac-928d-9420fefaa767 tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] 10.222.0.42 "GET /compute/v2.1/servers/8e9cb9c1-7df9-4cb7-9121-54bf74f552c7" status: 200 len: 1261 microversion: 2.1 time: 0.095301 Jun 06 10:41:28.908518 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 186/392] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:41:28 2022] GET /compute/v2.1/servers/8e9cb9c1-7df9-4cb7-9121-54bf74f552c7 => generated 1261 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:41:29.000004 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-5558b95d-f1a7-4e9b-8909-dfbb45441b29 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:41:29.009085 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-5558b95d-f1a7-4e9b-8909-dfbb45441b29 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:41:29.010604 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-5558b95d-f1a7-4e9b-8909-dfbb45441b29 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:41:29.011774 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-5558b95d-f1a7-4e9b-8909-dfbb45441b29 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0a79a6-8e61-477e-8269-730dfb6d04a6" status: 200 len: 1807 microversion: 2.20 time: 0.182100 Jun 06 10:41:29.013086 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 207/393] 10.222.0.42 () {60 vars in 1276 bytes} [Mon Jun 6 10:41:28 2022] GET /compute/v2.1/servers/5a0a79a6-8e61-477e-8269-730dfb6d04a6 => generated 1807 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 06 10:41:29.925218 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-299e34a0-4e90-45cf-9490-07ca7a2bee6e tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:41:29.926241 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-299e34a0-4e90-45cf-9490-07ca7a2bee6e tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] [instance: 8e9cb9c1-7df9-4cb7-9121-54bf74f552c7] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:41:29.933991 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-299e34a0-4e90-45cf-9490-07ca7a2bee6e tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:41:29.934724 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-299e34a0-4e90-45cf-9490-07ca7a2bee6e tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:41:29.935498 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-299e34a0-4e90-45cf-9490-07ca7a2bee6e tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:41:29.935968 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-299e34a0-4e90-45cf-9490-07ca7a2bee6e tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:41:30.004386 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-299e34a0-4e90-45cf-9490-07ca7a2bee6e tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7b11ed004fc4ef3a1f1c48adf31fe8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '645eadf589944a24bf6e27326a61952c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:41:30.012239 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-299e34a0-4e90-45cf-9490-07ca7a2bee6e tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] 10.222.0.42 "GET /compute/v2.1/servers/8e9cb9c1-7df9-4cb7-9121-54bf74f552c7" status: 200 len: 1261 microversion: 2.1 time: 0.090944 Jun 06 10:41:30.012799 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 187/394] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:41:29 2022] GET /compute/v2.1/servers/8e9cb9c1-7df9-4cb7-9121-54bf74f552c7 => generated 1261 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:41:30.030616 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-573717d2-1314-4f39-a702-eb9d5deab3b3 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:41:30.031401 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-573717d2-1314-4f39-a702-eb9d5deab3b3 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] [instance: 5a0a79a6-8e61-477e-8269-730dfb6d04a6] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:41:30.038841 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-573717d2-1314-4f39-a702-eb9d5deab3b3 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:41:30.039292 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-573717d2-1314-4f39-a702-eb9d5deab3b3 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:41:30.040107 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-573717d2-1314-4f39-a702-eb9d5deab3b3 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:41:30.040546 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-573717d2-1314-4f39-a702-eb9d5deab3b3 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:41:30.192522 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-573717d2-1314-4f39-a702-eb9d5deab3b3 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:41:30.201239 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-573717d2-1314-4f39-a702-eb9d5deab3b3 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:41:30.203565 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-573717d2-1314-4f39-a702-eb9d5deab3b3 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:41:30.204823 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-573717d2-1314-4f39-a702-eb9d5deab3b3 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0a79a6-8e61-477e-8269-730dfb6d04a6" status: 200 len: 1807 microversion: 2.20 time: 0.178065 Jun 06 10:41:30.205371 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 208/395] 10.222.0.42 () {60 vars in 1276 bytes} [Mon Jun 6 10:41:30 2022] GET /compute/v2.1/servers/5a0a79a6-8e61-477e-8269-730dfb6d04a6 => generated 1807 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 06 10:41:31.028936 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-f214415f-a2cb-416f-90f3-eeb318fcb951 tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:41:31.029549 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-f214415f-a2cb-416f-90f3-eeb318fcb951 tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] [instance: 8e9cb9c1-7df9-4cb7-9121-54bf74f552c7] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:41:31.036307 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-f214415f-a2cb-416f-90f3-eeb318fcb951 tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:41:31.036747 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-f214415f-a2cb-416f-90f3-eeb318fcb951 tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:41:31.037505 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-f214415f-a2cb-416f-90f3-eeb318fcb951 tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:41:31.037938 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-f214415f-a2cb-416f-90f3-eeb318fcb951 tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:41:31.097541 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-f214415f-a2cb-416f-90f3-eeb318fcb951 tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7b11ed004fc4ef3a1f1c48adf31fe8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '645eadf589944a24bf6e27326a61952c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:41:31.104852 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-f214415f-a2cb-416f-90f3-eeb318fcb951 tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] 10.222.0.42 "GET /compute/v2.1/servers/8e9cb9c1-7df9-4cb7-9121-54bf74f552c7" status: 200 len: 1253 microversion: 2.1 time: 0.079695 Jun 06 10:41:31.105413 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 188/396] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:41:31 2022] GET /compute/v2.1/servers/8e9cb9c1-7df9-4cb7-9121-54bf74f552c7 => generated 1253 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:41:31.224064 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-8139a720-82a6-47e2-8064-15509650fafd tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:41:31.225222 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-8139a720-82a6-47e2-8064-15509650fafd tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] [instance: 5a0a79a6-8e61-477e-8269-730dfb6d04a6] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:41:31.232493 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-8139a720-82a6-47e2-8064-15509650fafd tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:41:31.232948 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-8139a720-82a6-47e2-8064-15509650fafd tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:41:31.233729 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-8139a720-82a6-47e2-8064-15509650fafd tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:41:31.234166 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-8139a720-82a6-47e2-8064-15509650fafd tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:41:31.364763 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-8139a720-82a6-47e2-8064-15509650fafd tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:41:31.372927 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-8139a720-82a6-47e2-8064-15509650fafd tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:41:31.374427 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-8139a720-82a6-47e2-8064-15509650fafd tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:41:31.375572 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-8139a720-82a6-47e2-8064-15509650fafd tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0a79a6-8e61-477e-8269-730dfb6d04a6" status: 200 len: 1807 microversion: 2.20 time: 0.155659 Jun 06 10:41:31.376162 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 209/397] 10.222.0.42 () {60 vars in 1276 bytes} [Mon Jun 6 10:41:31 2022] GET /compute/v2.1/servers/5a0a79a6-8e61-477e-8269-730dfb6d04a6 => generated 1807 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 10:41:31.572277 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-bc7be649-5264-439f-bbaa-2942c647408d tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:41:31.572770 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-bc7be649-5264-439f-bbaa-2942c647408d tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] [instance: f49079c1-1384-4136-b6cf-eadc40fb5aa1] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:41:31.579056 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-bc7be649-5264-439f-bbaa-2942c647408d tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:41:31.579540 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-bc7be649-5264-439f-bbaa-2942c647408d tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:41:31.580360 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-bc7be649-5264-439f-bbaa-2942c647408d tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:41:31.580787 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-bc7be649-5264-439f-bbaa-2942c647408d tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:41:31.728834 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.objects.instance [None req-bc7be649-5264-439f-bbaa-2942c647408d tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lazy-loading 'services' on Instance uuid f49079c1-1384-4136-b6cf-eadc40fb5aa1 {{(pid=129350) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 06 10:41:31.846138 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-bc7be649-5264-439f-bbaa-2942c647408d tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] 10.222.0.42 "DELETE /compute/v2.1/servers/f49079c1-1384-4136-b6cf-eadc40fb5aa1/os-volume_attachments/0d9d5a60-9d11-4a3c-9098-bd81642ee939" status: 202 len: 0 microversion: 2.1 time: 0.277704 Jun 06 10:41:31.846865 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 189/398] 10.222.0.42 () {58 vars in 1415 bytes} [Mon Jun 6 10:41:31 2022] DELETE /compute/v2.1/servers/f49079c1-1384-4136-b6cf-eadc40fb5aa1/os-volume_attachments/0d9d5a60-9d11-4a3c-9098-bd81642ee939 => generated 0 bytes in 279 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 06 10:41:32.124902 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-391c8fb3-4caa-40a8-848f-f48cebc16e3c tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:41:32.125929 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-391c8fb3-4caa-40a8-848f-f48cebc16e3c tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] [instance: 8e9cb9c1-7df9-4cb7-9121-54bf74f552c7] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:41:32.141361 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-391c8fb3-4caa-40a8-848f-f48cebc16e3c tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:41:32.144512 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-391c8fb3-4caa-40a8-848f-f48cebc16e3c tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:41:32.148079 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-391c8fb3-4caa-40a8-848f-f48cebc16e3c tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:41:32.148670 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-391c8fb3-4caa-40a8-848f-f48cebc16e3c tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:41:32.287071 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-391c8fb3-4caa-40a8-848f-f48cebc16e3c tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7b11ed004fc4ef3a1f1c48adf31fe8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '645eadf589944a24bf6e27326a61952c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:41:32.299834 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-391c8fb3-4caa-40a8-848f-f48cebc16e3c tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] 10.222.0.42 "GET /compute/v2.1/servers/8e9cb9c1-7df9-4cb7-9121-54bf74f552c7" status: 200 len: 1315 microversion: 2.1 time: 0.180693 Jun 06 10:41:32.311398 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 210/399] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:41:32 2022] GET /compute/v2.1/servers/8e9cb9c1-7df9-4cb7-9121-54bf74f552c7 => generated 1315 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:41:32.398358 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-7690aab0-8bf2-4d85-9544-9b299220a474 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:41:32.399593 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-7690aab0-8bf2-4d85-9544-9b299220a474 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] [instance: 5a0a79a6-8e61-477e-8269-730dfb6d04a6] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:41:32.410789 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-7690aab0-8bf2-4d85-9544-9b299220a474 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:41:32.412160 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-7690aab0-8bf2-4d85-9544-9b299220a474 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:41:32.413676 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-7690aab0-8bf2-4d85-9544-9b299220a474 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:41:32.414424 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-7690aab0-8bf2-4d85-9544-9b299220a474 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:41:32.643933 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-7690aab0-8bf2-4d85-9544-9b299220a474 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:41:32.654032 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-7690aab0-8bf2-4d85-9544-9b299220a474 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:41:32.655871 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-7690aab0-8bf2-4d85-9544-9b299220a474 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:41:32.657557 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-7690aab0-8bf2-4d85-9544-9b299220a474 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0a79a6-8e61-477e-8269-730dfb6d04a6" status: 200 len: 1807 microversion: 2.20 time: 0.266663 Jun 06 10:41:32.669654 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 190/400] 10.222.0.42 () {60 vars in 1276 bytes} [Mon Jun 6 10:41:32 2022] GET /compute/v2.1/servers/5a0a79a6-8e61-477e-8269-730dfb6d04a6 => generated 1807 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 10:41:33.318597 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-d89e9516-2f86-40c5-85fa-0db067b4fdac tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:41:33.319869 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-d89e9516-2f86-40c5-85fa-0db067b4fdac tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] [instance: 8e9cb9c1-7df9-4cb7-9121-54bf74f552c7] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:41:33.326509 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-d89e9516-2f86-40c5-85fa-0db067b4fdac tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:41:33.326956 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-d89e9516-2f86-40c5-85fa-0db067b4fdac tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:41:33.327727 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-d89e9516-2f86-40c5-85fa-0db067b4fdac tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:41:33.328186 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-d89e9516-2f86-40c5-85fa-0db067b4fdac tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:41:33.482778 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-d89e9516-2f86-40c5-85fa-0db067b4fdac tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7b11ed004fc4ef3a1f1c48adf31fe8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '645eadf589944a24bf6e27326a61952c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:41:33.490857 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-d89e9516-2f86-40c5-85fa-0db067b4fdac tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] 10.222.0.42 "GET /compute/v2.1/servers/8e9cb9c1-7df9-4cb7-9121-54bf74f552c7" status: 200 len: 1357 microversion: 2.1 time: 0.176104 Jun 06 10:41:33.491604 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 211/401] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:41:33 2022] GET /compute/v2.1/servers/8e9cb9c1-7df9-4cb7-9121-54bf74f552c7 => generated 1357 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:41:33.677638 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-eb633bef-6507-42bc-ab5d-1e2e6923ecc6 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:41:33.678409 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-eb633bef-6507-42bc-ab5d-1e2e6923ecc6 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] [instance: 5a0a79a6-8e61-477e-8269-730dfb6d04a6] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:41:33.685222 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-eb633bef-6507-42bc-ab5d-1e2e6923ecc6 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:41:33.685705 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-eb633bef-6507-42bc-ab5d-1e2e6923ecc6 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:41:33.686525 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-eb633bef-6507-42bc-ab5d-1e2e6923ecc6 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:41:33.686962 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-eb633bef-6507-42bc-ab5d-1e2e6923ecc6 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:41:33.843096 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-eb633bef-6507-42bc-ab5d-1e2e6923ecc6 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:41:33.852450 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-eb633bef-6507-42bc-ab5d-1e2e6923ecc6 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:41:33.854395 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-eb633bef-6507-42bc-ab5d-1e2e6923ecc6 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:41:33.855557 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-eb633bef-6507-42bc-ab5d-1e2e6923ecc6 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0a79a6-8e61-477e-8269-730dfb6d04a6" status: 200 len: 1807 microversion: 2.20 time: 0.182152 Jun 06 10:41:33.856142 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 191/402] 10.222.0.42 () {60 vars in 1276 bytes} [Mon Jun 6 10:41:33 2022] GET /compute/v2.1/servers/5a0a79a6-8e61-477e-8269-730dfb6d04a6 => generated 1807 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 10:41:34.511568 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-61faa7c3-8451-4cef-936f-3c34347c5473 tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:41:34.511568 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-61faa7c3-8451-4cef-936f-3c34347c5473 tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] [instance: 8e9cb9c1-7df9-4cb7-9121-54bf74f552c7] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:41:34.513016 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG dbcounter [-] [129349] Writing DB stats nova_cell0:SELECT=2 {{(pid=129349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 10:41:34.513726 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG dbcounter [-] [129349] Writing DB stats nova_cell0:SELECT=6 {{(pid=129349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 10:41:34.516975 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-61faa7c3-8451-4cef-936f-3c34347c5473 tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:41:34.517543 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-61faa7c3-8451-4cef-936f-3c34347c5473 tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:41:34.518643 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-61faa7c3-8451-4cef-936f-3c34347c5473 tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:41:34.519285 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-61faa7c3-8451-4cef-936f-3c34347c5473 tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:41:34.659509 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-61faa7c3-8451-4cef-936f-3c34347c5473 tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7b11ed004fc4ef3a1f1c48adf31fe8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '645eadf589944a24bf6e27326a61952c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:41:34.668688 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-61faa7c3-8451-4cef-936f-3c34347c5473 tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] 10.222.0.42 "GET /compute/v2.1/servers/8e9cb9c1-7df9-4cb7-9121-54bf74f552c7" status: 200 len: 1357 microversion: 2.1 time: 0.165304 Jun 06 10:41:34.679350 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 212/403] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:41:34 2022] GET /compute/v2.1/servers/8e9cb9c1-7df9-4cb7-9121-54bf74f552c7 => generated 1357 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:41:34.884301 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-f4be8771-614e-4a69-98ab-e2c849d89ae0 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:41:34.884991 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-f4be8771-614e-4a69-98ab-e2c849d89ae0 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] [instance: 5a0a79a6-8e61-477e-8269-730dfb6d04a6] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:41:34.887046 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG dbcounter [-] [129350] Writing DB stats nova_cell0:SELECT=6 {{(pid=129350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 10:41:34.893515 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-f4be8771-614e-4a69-98ab-e2c849d89ae0 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:41:34.894039 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-f4be8771-614e-4a69-98ab-e2c849d89ae0 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:41:34.895446 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-f4be8771-614e-4a69-98ab-e2c849d89ae0 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:41:34.896202 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-f4be8771-614e-4a69-98ab-e2c849d89ae0 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:41:35.053043 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-f4be8771-614e-4a69-98ab-e2c849d89ae0 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:41:35.065855 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-f4be8771-614e-4a69-98ab-e2c849d89ae0 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:41:35.067538 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-f4be8771-614e-4a69-98ab-e2c849d89ae0 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:41:35.068765 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-f4be8771-614e-4a69-98ab-e2c849d89ae0 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0a79a6-8e61-477e-8269-730dfb6d04a6" status: 200 len: 1807 microversion: 2.20 time: 0.188366 Jun 06 10:41:35.069258 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 192/404] 10.222.0.42 () {60 vars in 1276 bytes} [Mon Jun 6 10:41:34 2022] GET /compute/v2.1/servers/5a0a79a6-8e61-477e-8269-730dfb6d04a6 => generated 1807 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 10:41:35.686763 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-d1fb7f19-7f2c-41b5-8298-196fd87f605f tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:41:35.688132 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-d1fb7f19-7f2c-41b5-8298-196fd87f605f tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] [instance: 8e9cb9c1-7df9-4cb7-9121-54bf74f552c7] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:41:35.690564 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG dbcounter [-] [129349] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=3 {{(pid=129349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 10:41:35.696475 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-d1fb7f19-7f2c-41b5-8298-196fd87f605f tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:41:35.696930 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-d1fb7f19-7f2c-41b5-8298-196fd87f605f tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:41:35.697704 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-d1fb7f19-7f2c-41b5-8298-196fd87f605f tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:41:35.698145 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-d1fb7f19-7f2c-41b5-8298-196fd87f605f tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:41:35.842955 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-d1fb7f19-7f2c-41b5-8298-196fd87f605f tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7b11ed004fc4ef3a1f1c48adf31fe8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '645eadf589944a24bf6e27326a61952c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:41:35.852355 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-d1fb7f19-7f2c-41b5-8298-196fd87f605f tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] 10.222.0.42 "GET /compute/v2.1/servers/8e9cb9c1-7df9-4cb7-9121-54bf74f552c7" status: 200 len: 1357 microversion: 2.1 time: 0.169647 Jun 06 10:41:35.852968 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 213/405] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:41:35 2022] GET /compute/v2.1/servers/8e9cb9c1-7df9-4cb7-9121-54bf74f552c7 => generated 1357 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:41:36.086963 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-d3f98a61-8e5e-40a8-86bd-5d3be8b927bc tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:41:36.087570 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-d3f98a61-8e5e-40a8-86bd-5d3be8b927bc tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] [instance: 5a0a79a6-8e61-477e-8269-730dfb6d04a6] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:41:36.096793 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-d3f98a61-8e5e-40a8-86bd-5d3be8b927bc tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:41:36.097651 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-d3f98a61-8e5e-40a8-86bd-5d3be8b927bc tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:41:36.098939 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-d3f98a61-8e5e-40a8-86bd-5d3be8b927bc tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:41:36.109509 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-d3f98a61-8e5e-40a8-86bd-5d3be8b927bc tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:41:36.265367 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-d3f98a61-8e5e-40a8-86bd-5d3be8b927bc tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:41:36.275964 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-d3f98a61-8e5e-40a8-86bd-5d3be8b927bc tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:41:36.277485 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-d3f98a61-8e5e-40a8-86bd-5d3be8b927bc tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:41:36.278623 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-d3f98a61-8e5e-40a8-86bd-5d3be8b927bc tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0a79a6-8e61-477e-8269-730dfb6d04a6" status: 200 len: 1807 microversion: 2.20 time: 0.196381 Jun 06 10:41:36.279178 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 193/406] 10.222.0.42 () {60 vars in 1276 bytes} [Mon Jun 6 10:41:36 2022] GET /compute/v2.1/servers/5a0a79a6-8e61-477e-8269-730dfb6d04a6 => generated 1807 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 10:41:36.872770 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-443959e1-940e-4531-b3d1-f4ffc40c5b27 tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:41:36.874628 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-443959e1-940e-4531-b3d1-f4ffc40c5b27 tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] [instance: 8e9cb9c1-7df9-4cb7-9121-54bf74f552c7] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:41:36.884335 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-443959e1-940e-4531-b3d1-f4ffc40c5b27 tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:41:36.884988 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-443959e1-940e-4531-b3d1-f4ffc40c5b27 tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:41:36.886495 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-443959e1-940e-4531-b3d1-f4ffc40c5b27 tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:41:36.887231 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-443959e1-940e-4531-b3d1-f4ffc40c5b27 tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:41:37.030850 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-443959e1-940e-4531-b3d1-f4ffc40c5b27 tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7b11ed004fc4ef3a1f1c48adf31fe8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '645eadf589944a24bf6e27326a61952c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:41:37.039454 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-443959e1-940e-4531-b3d1-f4ffc40c5b27 tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] 10.222.0.42 "GET /compute/v2.1/servers/8e9cb9c1-7df9-4cb7-9121-54bf74f552c7" status: 200 len: 1357 microversion: 2.1 time: 0.172829 Jun 06 10:41:37.040031 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 214/407] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:41:36 2022] GET /compute/v2.1/servers/8e9cb9c1-7df9-4cb7-9121-54bf74f552c7 => generated 1357 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:41:37.299857 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-ddd1fe9d-131a-435e-b509-bf64e8b93890 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:41:37.301789 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-ddd1fe9d-131a-435e-b509-bf64e8b93890 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] [instance: 5a0a79a6-8e61-477e-8269-730dfb6d04a6] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:41:37.306004 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG dbcounter [-] [129350] Writing DB stats nova_api:SELECT=61,nova_api:INSERT=1 {{(pid=129350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 10:41:37.310583 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-ddd1fe9d-131a-435e-b509-bf64e8b93890 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:41:37.311552 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-ddd1fe9d-131a-435e-b509-bf64e8b93890 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:41:37.312599 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-ddd1fe9d-131a-435e-b509-bf64e8b93890 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:41:37.313257 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-ddd1fe9d-131a-435e-b509-bf64e8b93890 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:41:37.470980 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-ddd1fe9d-131a-435e-b509-bf64e8b93890 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:41:37.481085 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-ddd1fe9d-131a-435e-b509-bf64e8b93890 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:41:37.482660 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-ddd1fe9d-131a-435e-b509-bf64e8b93890 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:41:37.483929 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-ddd1fe9d-131a-435e-b509-bf64e8b93890 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0a79a6-8e61-477e-8269-730dfb6d04a6" status: 200 len: 1807 microversion: 2.20 time: 0.189841 Jun 06 10:41:37.487967 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 194/408] 10.222.0.42 () {60 vars in 1276 bytes} [Mon Jun 6 10:41:37 2022] GET /compute/v2.1/servers/5a0a79a6-8e61-477e-8269-730dfb6d04a6 => generated 1807 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 06 10:41:38.057260 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-a4b7cd0e-1912-4971-b571-31475c423592 tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:41:38.058001 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-a4b7cd0e-1912-4971-b571-31475c423592 tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] [instance: 8e9cb9c1-7df9-4cb7-9121-54bf74f552c7] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:41:38.065054 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-a4b7cd0e-1912-4971-b571-31475c423592 tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:41:38.065493 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-a4b7cd0e-1912-4971-b571-31475c423592 tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:41:38.067156 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-a4b7cd0e-1912-4971-b571-31475c423592 tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:41:38.067832 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-a4b7cd0e-1912-4971-b571-31475c423592 tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:41:38.216700 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-a4b7cd0e-1912-4971-b571-31475c423592 tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7b11ed004fc4ef3a1f1c48adf31fe8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '645eadf589944a24bf6e27326a61952c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:41:38.224481 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-a4b7cd0e-1912-4971-b571-31475c423592 tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] 10.222.0.42 "GET /compute/v2.1/servers/8e9cb9c1-7df9-4cb7-9121-54bf74f552c7" status: 200 len: 1357 microversion: 2.1 time: 0.170975 Jun 06 10:41:38.225283 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 215/409] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:41:38 2022] GET /compute/v2.1/servers/8e9cb9c1-7df9-4cb7-9121-54bf74f552c7 => generated 1357 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:41:38.502384 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-25173534-c32f-44f1-ac08-17a69e7d686f tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:41:38.502991 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-25173534-c32f-44f1-ac08-17a69e7d686f tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] [instance: 5a0a79a6-8e61-477e-8269-730dfb6d04a6] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:41:38.510618 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-25173534-c32f-44f1-ac08-17a69e7d686f tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:41:38.511061 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-25173534-c32f-44f1-ac08-17a69e7d686f tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:41:38.511844 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-25173534-c32f-44f1-ac08-17a69e7d686f tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:41:38.512275 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-25173534-c32f-44f1-ac08-17a69e7d686f tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:41:38.663554 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-25173534-c32f-44f1-ac08-17a69e7d686f tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:41:38.672789 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-25173534-c32f-44f1-ac08-17a69e7d686f tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:41:38.674293 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-25173534-c32f-44f1-ac08-17a69e7d686f tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:41:38.675478 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-25173534-c32f-44f1-ac08-17a69e7d686f tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0a79a6-8e61-477e-8269-730dfb6d04a6" status: 200 len: 1807 microversion: 2.20 time: 0.176920 Jun 06 10:41:38.676583 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 195/410] 10.222.0.42 () {60 vars in 1276 bytes} [Mon Jun 6 10:41:38 2022] GET /compute/v2.1/servers/5a0a79a6-8e61-477e-8269-730dfb6d04a6 => generated 1807 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 10:41:39.241798 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-12d86740-070d-4209-b58c-2dd75e2d7329 tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:41:39.242441 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-12d86740-070d-4209-b58c-2dd75e2d7329 tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] [instance: 8e9cb9c1-7df9-4cb7-9121-54bf74f552c7] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:41:39.249478 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-12d86740-070d-4209-b58c-2dd75e2d7329 tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:41:39.249890 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-12d86740-070d-4209-b58c-2dd75e2d7329 tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:41:39.250769 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-12d86740-070d-4209-b58c-2dd75e2d7329 tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:41:39.251213 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-12d86740-070d-4209-b58c-2dd75e2d7329 tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:41:39.397078 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-12d86740-070d-4209-b58c-2dd75e2d7329 tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7b11ed004fc4ef3a1f1c48adf31fe8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '645eadf589944a24bf6e27326a61952c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:41:39.404755 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-12d86740-070d-4209-b58c-2dd75e2d7329 tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] 10.222.0.42 "GET /compute/v2.1/servers/8e9cb9c1-7df9-4cb7-9121-54bf74f552c7" status: 200 len: 1357 microversion: 2.1 time: 0.167467 Jun 06 10:41:39.405324 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 216/411] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:41:39 2022] GET /compute/v2.1/servers/8e9cb9c1-7df9-4cb7-9121-54bf74f552c7 => generated 1357 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:41:39.695180 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-d9b6c888-c870-42e6-838f-fa26edee08b1 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:41:39.695821 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-d9b6c888-c870-42e6-838f-fa26edee08b1 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] [instance: 5a0a79a6-8e61-477e-8269-730dfb6d04a6] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:41:39.703066 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-d9b6c888-c870-42e6-838f-fa26edee08b1 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:41:39.703514 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-d9b6c888-c870-42e6-838f-fa26edee08b1 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:41:39.704354 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-d9b6c888-c870-42e6-838f-fa26edee08b1 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:41:39.704788 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-d9b6c888-c870-42e6-838f-fa26edee08b1 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:41:39.841991 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-d9b6c888-c870-42e6-838f-fa26edee08b1 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:41:39.851137 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-d9b6c888-c870-42e6-838f-fa26edee08b1 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:41:39.852828 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-d9b6c888-c870-42e6-838f-fa26edee08b1 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:41:39.854064 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-d9b6c888-c870-42e6-838f-fa26edee08b1 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0a79a6-8e61-477e-8269-730dfb6d04a6" status: 200 len: 1807 microversion: 2.20 time: 0.163560 Jun 06 10:41:39.855092 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 196/412] 10.222.0.42 () {60 vars in 1276 bytes} [Mon Jun 6 10:41:39 2022] GET /compute/v2.1/servers/5a0a79a6-8e61-477e-8269-730dfb6d04a6 => generated 1807 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 10:41:40.422304 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-d8ef0773-8056-4d33-a802-05e9e554878b tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:41:40.422924 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-d8ef0773-8056-4d33-a802-05e9e554878b tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] [instance: 8e9cb9c1-7df9-4cb7-9121-54bf74f552c7] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:41:40.430338 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-d8ef0773-8056-4d33-a802-05e9e554878b tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:41:40.430787 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-d8ef0773-8056-4d33-a802-05e9e554878b tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:41:40.431556 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-d8ef0773-8056-4d33-a802-05e9e554878b tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:41:40.432020 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-d8ef0773-8056-4d33-a802-05e9e554878b tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:41:40.562289 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-d8ef0773-8056-4d33-a802-05e9e554878b tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7b11ed004fc4ef3a1f1c48adf31fe8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '645eadf589944a24bf6e27326a61952c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:41:40.569809 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-d8ef0773-8056-4d33-a802-05e9e554878b tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] 10.222.0.42 "GET /compute/v2.1/servers/8e9cb9c1-7df9-4cb7-9121-54bf74f552c7" status: 200 len: 1357 microversion: 2.1 time: 0.151320 Jun 06 10:41:40.570375 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 217/413] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:41:40 2022] GET /compute/v2.1/servers/8e9cb9c1-7df9-4cb7-9121-54bf74f552c7 => generated 1357 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:41:40.873117 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-ce8e74ae-4251-4b3c-b2a5-4f9bcd26d49a tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:41:40.873757 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-ce8e74ae-4251-4b3c-b2a5-4f9bcd26d49a tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] [instance: 5a0a79a6-8e61-477e-8269-730dfb6d04a6] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:41:40.881450 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-ce8e74ae-4251-4b3c-b2a5-4f9bcd26d49a tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:41:40.882103 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-ce8e74ae-4251-4b3c-b2a5-4f9bcd26d49a tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:41:40.882867 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-ce8e74ae-4251-4b3c-b2a5-4f9bcd26d49a tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:41:40.883303 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-ce8e74ae-4251-4b3c-b2a5-4f9bcd26d49a tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:41:41.092513 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-ce8e74ae-4251-4b3c-b2a5-4f9bcd26d49a tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:41:41.101378 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-ce8e74ae-4251-4b3c-b2a5-4f9bcd26d49a tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:41:41.102877 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-ce8e74ae-4251-4b3c-b2a5-4f9bcd26d49a tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:41:41.104049 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-ce8e74ae-4251-4b3c-b2a5-4f9bcd26d49a tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0a79a6-8e61-477e-8269-730dfb6d04a6" status: 200 len: 1807 microversion: 2.20 time: 0.234981 Jun 06 10:41:41.104916 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 197/414] 10.222.0.42 () {60 vars in 1276 bytes} [Mon Jun 6 10:41:40 2022] GET /compute/v2.1/servers/5a0a79a6-8e61-477e-8269-730dfb6d04a6 => generated 1807 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 10:41:41.457249 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [req-8fc236e1-40ec-473c-828e-8f558ccd691e req-065510b4-5f01-4155-b8e4-ef1e203d8000 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8e9cb9c1-7df9-4cb7-9121-54bf74f552c7", "tag": "d50634ea-b30b-4bd6-b547-ee82d39a4a57"}]} {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 10:41:41.468428 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [req-8fc236e1-40ec-473c-828e-8f558ccd691e req-065510b4-5f01-4155-b8e4-ef1e203d8000 service nova] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:41:41.469414 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [req-8fc236e1-40ec-473c-828e-8f558ccd691e req-065510b4-5f01-4155-b8e4-ef1e203d8000 service nova] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:41:41.485831 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.compute.server_external_events [req-8fc236e1-40ec-473c-828e-8f558ccd691e req-065510b4-5f01-4155-b8e4-ef1e203d8000 service nova] Creating event network-changed:d50634ea-b30b-4bd6-b547-ee82d39a4a57 for instance 8e9cb9c1-7df9-4cb7-9121-54bf74f552c7 on hv-cinder-84482 Jun 06 10:41:41.491509 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [req-8fc236e1-40ec-473c-828e-8f558ccd691e req-065510b4-5f01-4155-b8e4-ef1e203d8000 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038314 Jun 06 10:41:41.492430 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 218/415] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Jun 6 10:41:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 10:41:41.590522 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-ad95b24d-4216-4e1c-92f8-3a21cbc74d07 tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:41:41.591551 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-ad95b24d-4216-4e1c-92f8-3a21cbc74d07 tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] [instance: 8e9cb9c1-7df9-4cb7-9121-54bf74f552c7] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:41:41.598827 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-ad95b24d-4216-4e1c-92f8-3a21cbc74d07 tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:41:41.599475 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-ad95b24d-4216-4e1c-92f8-3a21cbc74d07 tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:41:41.600576 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-ad95b24d-4216-4e1c-92f8-3a21cbc74d07 tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:41:41.601015 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-ad95b24d-4216-4e1c-92f8-3a21cbc74d07 tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:41:41.603813 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG dbcounter [-] [129350] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=129350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 10:41:41.736295 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-ad95b24d-4216-4e1c-92f8-3a21cbc74d07 tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7b11ed004fc4ef3a1f1c48adf31fe8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '645eadf589944a24bf6e27326a61952c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:41:41.743766 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-ad95b24d-4216-4e1c-92f8-3a21cbc74d07 tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] 10.222.0.42 "GET /compute/v2.1/servers/8e9cb9c1-7df9-4cb7-9121-54bf74f552c7" status: 200 len: 1357 microversion: 2.1 time: 0.160347 Jun 06 10:41:41.744339 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 198/416] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:41:41 2022] GET /compute/v2.1/servers/8e9cb9c1-7df9-4cb7-9121-54bf74f552c7 => generated 1357 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:41:42.123816 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-f1c3289b-5bfa-439b-b8e8-98c3f0b5d3a8 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:41:42.124525 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-f1c3289b-5bfa-439b-b8e8-98c3f0b5d3a8 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] [instance: 5a0a79a6-8e61-477e-8269-730dfb6d04a6] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:41:42.132297 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-f1c3289b-5bfa-439b-b8e8-98c3f0b5d3a8 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:41:42.132808 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-f1c3289b-5bfa-439b-b8e8-98c3f0b5d3a8 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:41:42.133895 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-f1c3289b-5bfa-439b-b8e8-98c3f0b5d3a8 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:41:42.134412 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-f1c3289b-5bfa-439b-b8e8-98c3f0b5d3a8 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:41:42.323766 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-d0d2bec1-1c41-4a27-ab06-2b4aebee2801 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 10:41:42.324804 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-d0d2bec1-1c41-4a27-ab06-2b4aebee2801 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] [instance: d4d7ae82-4a52-4e0e-87b5-13a5b95cc3a0] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:41:42.331180 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-d0d2bec1-1c41-4a27-ab06-2b4aebee2801 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:41:42.331628 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-d0d2bec1-1c41-4a27-ab06-2b4aebee2801 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:41:42.332464 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-d0d2bec1-1c41-4a27-ab06-2b4aebee2801 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:41:42.332897 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-d0d2bec1-1c41-4a27-ab06-2b4aebee2801 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:41:42.354993 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.objects.instance [None req-d0d2bec1-1c41-4a27-ab06-2b4aebee2801 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lazy-loading 'flavor' on Instance uuid d4d7ae82-4a52-4e0e-87b5-13a5b95cc3a0 {{(pid=129350) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 06 10:41:42.382746 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-f1c3289b-5bfa-439b-b8e8-98c3f0b5d3a8 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:41:42.387936 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-f1c3289b-5bfa-439b-b8e8-98c3f0b5d3a8 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:41:42.389681 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-f1c3289b-5bfa-439b-b8e8-98c3f0b5d3a8 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:41:42.390916 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-f1c3289b-5bfa-439b-b8e8-98c3f0b5d3a8 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0a79a6-8e61-477e-8269-730dfb6d04a6" status: 200 len: 1807 microversion: 2.20 time: 0.271479 Jun 06 10:41:42.391470 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 219/417] 10.222.0.42 () {60 vars in 1276 bytes} [Mon Jun 6 10:41:42 2022] GET /compute/v2.1/servers/5a0a79a6-8e61-477e-8269-730dfb6d04a6 => generated 1807 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 10:41:42.471075 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-d0d2bec1-1c41-4a27-ab06-2b4aebee2801 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] 10.222.0.42 "POST /compute/v2.1/servers/d4d7ae82-4a52-4e0e-87b5-13a5b95cc3a0/action" status: 200 len: 32 microversion: 2.1 time: 0.151181 Jun 06 10:41:42.471716 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 199/418] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Jun 6 10:41:42 2022] POST /compute/v2.1/servers/d4d7ae82-4a52-4e0e-87b5-13a5b95cc3a0/action => generated 32 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 06 10:41:42.480571 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-7dcd11a8-2875-4513-be03-415f8cf846cb tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:41:42.481215 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-7dcd11a8-2875-4513-be03-415f8cf846cb tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] [instance: d4d7ae82-4a52-4e0e-87b5-13a5b95cc3a0] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:41:42.487600 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-7dcd11a8-2875-4513-be03-415f8cf846cb tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:41:42.488577 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-7dcd11a8-2875-4513-be03-415f8cf846cb tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:41:42.489485 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-7dcd11a8-2875-4513-be03-415f8cf846cb tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:41:42.489923 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-7dcd11a8-2875-4513-be03-415f8cf846cb tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:41:42.760852 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-fb7272de-d502-4e3c-9cd5-7e00f90d3293 tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:41:42.761563 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-fb7272de-d502-4e3c-9cd5-7e00f90d3293 tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] [instance: 8e9cb9c1-7df9-4cb7-9121-54bf74f552c7] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:41:42.768831 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-fb7272de-d502-4e3c-9cd5-7e00f90d3293 tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:41:42.769281 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-fb7272de-d502-4e3c-9cd5-7e00f90d3293 tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:41:42.770063 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-fb7272de-d502-4e3c-9cd5-7e00f90d3293 tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:41:42.770603 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-fb7272de-d502-4e3c-9cd5-7e00f90d3293 tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:41:43.173977 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-7dcd11a8-2875-4513-be03-415f8cf846cb tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f269e146c844480c822347c3a38d103b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2b17b61b73b4e6d81dd8ffe9cf311ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:41:43.182561 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-7dcd11a8-2875-4513-be03-415f8cf846cb tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] 10.222.0.42 "GET /compute/v2.1/servers/d4d7ae82-4a52-4e0e-87b5-13a5b95cc3a0" status: 200 len: 1734 microversion: 2.1 time: 0.705713 Jun 06 10:41:43.183127 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 220/419] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:41:42 2022] GET /compute/v2.1/servers/d4d7ae82-4a52-4e0e-87b5-13a5b95cc3a0 => generated 1734 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:41:43.206572 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-fb7272de-d502-4e3c-9cd5-7e00f90d3293 tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7b11ed004fc4ef3a1f1c48adf31fe8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '645eadf589944a24bf6e27326a61952c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:41:43.214167 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-fb7272de-d502-4e3c-9cd5-7e00f90d3293 tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] 10.222.0.42 "GET /compute/v2.1/servers/8e9cb9c1-7df9-4cb7-9121-54bf74f552c7" status: 200 len: 1357 microversion: 2.1 time: 0.457684 Jun 06 10:41:43.214815 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 200/420] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:41:42 2022] GET /compute/v2.1/servers/8e9cb9c1-7df9-4cb7-9121-54bf74f552c7 => generated 1357 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 10:41:43.409474 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-7e6e25c1-392a-4142-ab4e-14146635a393 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:41:43.410891 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-7e6e25c1-392a-4142-ab4e-14146635a393 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] [instance: 5a0a79a6-8e61-477e-8269-730dfb6d04a6] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:41:43.416945 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-7e6e25c1-392a-4142-ab4e-14146635a393 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:41:43.417384 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-7e6e25c1-392a-4142-ab4e-14146635a393 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:41:43.418388 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-7e6e25c1-392a-4142-ab4e-14146635a393 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:41:43.418567 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-7e6e25c1-392a-4142-ab4e-14146635a393 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:41:43.436773 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG dbcounter [-] [129349] Writing DB stats nova_cell1:SELECT=100 {{(pid=129349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 10:41:43.699732 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-cab4b270-539b-4a34-a46c-1a33a3e2856a tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 10:41:43.708241 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-cab4b270-539b-4a34-a46c-1a33a3e2856a tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:41:43.708705 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-cab4b270-539b-4a34-a46c-1a33a3e2856a tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:41:43.719970 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-7e6e25c1-392a-4142-ab4e-14146635a393 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:41:43.732602 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-7e6e25c1-392a-4142-ab4e-14146635a393 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:41:43.734976 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-7e6e25c1-392a-4142-ab4e-14146635a393 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:41:43.738601 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-7e6e25c1-392a-4142-ab4e-14146635a393 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0a79a6-8e61-477e-8269-730dfb6d04a6" status: 200 len: 1807 microversion: 2.20 time: 0.331995 Jun 06 10:41:43.740564 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 221/421] 10.222.0.42 () {60 vars in 1276 bytes} [Mon Jun 6 10:41:43 2022] GET /compute/v2.1/servers/5a0a79a6-8e61-477e-8269-730dfb6d04a6 => generated 1807 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 10:41:43.778775 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-cab4b270-539b-4a34-a46c-1a33a3e2856a tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] [instance: f49079c1-1384-4136-b6cf-eadc40fb5aa1] Going to try to stop instance {{(pid=129350) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 06 10:41:43.821887 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-cab4b270-539b-4a34-a46c-1a33a3e2856a tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] 10.222.0.42 "POST /compute/v2.1/servers/f49079c1-1384-4136-b6cf-eadc40fb5aa1/action" status: 202 len: 0 microversion: 2.1 time: 0.126777 Jun 06 10:41:43.822419 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 201/422] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Jun 6 10:41:43 2022] POST /compute/v2.1/servers/f49079c1-1384-4136-b6cf-eadc40fb5aa1/action => generated 0 bytes in 128 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 06 10:41:43.832211 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-5022e25b-86e7-4503-94f0-6fa8499f6763 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:41:43.833045 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-5022e25b-86e7-4503-94f0-6fa8499f6763 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] [instance: f49079c1-1384-4136-b6cf-eadc40fb5aa1] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:41:43.840084 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-5022e25b-86e7-4503-94f0-6fa8499f6763 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:41:43.840708 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-5022e25b-86e7-4503-94f0-6fa8499f6763 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:41:43.841612 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-5022e25b-86e7-4503-94f0-6fa8499f6763 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:41:43.848474 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-5022e25b-86e7-4503-94f0-6fa8499f6763 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:41:44.006016 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-5022e25b-86e7-4503-94f0-6fa8499f6763 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b7d82c999646b6b6b96d565f0e3f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe30c756a2f84166ad23af1edf83157e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:41:44.013440 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-5022e25b-86e7-4503-94f0-6fa8499f6763 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] 10.222.0.42 "GET /compute/v2.1/servers/f49079c1-1384-4136-b6cf-eadc40fb5aa1" status: 200 len: 1676 microversion: 2.1 time: 0.185344 Jun 06 10:41:44.014328 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 222/423] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:41:43 2022] GET /compute/v2.1/servers/f49079c1-1384-4136-b6cf-eadc40fb5aa1 => generated 1676 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:41:44.200539 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-17436e27-016f-4d7c-9f1c-7e48aa58222d tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:41:44.201266 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-17436e27-016f-4d7c-9f1c-7e48aa58222d tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] [instance: d4d7ae82-4a52-4e0e-87b5-13a5b95cc3a0] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:41:44.208348 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-17436e27-016f-4d7c-9f1c-7e48aa58222d tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:41:44.208737 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-17436e27-016f-4d7c-9f1c-7e48aa58222d tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:41:44.209492 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-17436e27-016f-4d7c-9f1c-7e48aa58222d tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:41:44.209921 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-17436e27-016f-4d7c-9f1c-7e48aa58222d tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:41:44.230698 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-4bdcd2c0-1024-41ba-9546-6cadf7375157 tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:41:44.231334 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-4bdcd2c0-1024-41ba-9546-6cadf7375157 tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] [instance: 8e9cb9c1-7df9-4cb7-9121-54bf74f552c7] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:41:44.237185 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-4bdcd2c0-1024-41ba-9546-6cadf7375157 tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:41:44.237621 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-4bdcd2c0-1024-41ba-9546-6cadf7375157 tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:41:44.238467 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-4bdcd2c0-1024-41ba-9546-6cadf7375157 tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:41:44.238893 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-4bdcd2c0-1024-41ba-9546-6cadf7375157 tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:41:44.414454 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-17436e27-016f-4d7c-9f1c-7e48aa58222d tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f269e146c844480c822347c3a38d103b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2b17b61b73b4e6d81dd8ffe9cf311ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:41:44.417414 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-4bdcd2c0-1024-41ba-9546-6cadf7375157 tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7b11ed004fc4ef3a1f1c48adf31fe8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '645eadf589944a24bf6e27326a61952c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:41:44.422546 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-17436e27-016f-4d7c-9f1c-7e48aa58222d tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] 10.222.0.42 "GET /compute/v2.1/servers/d4d7ae82-4a52-4e0e-87b5-13a5b95cc3a0" status: 200 len: 1734 microversion: 2.1 time: 0.226326 Jun 06 10:41:44.423116 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 202/424] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:41:44 2022] GET /compute/v2.1/servers/d4d7ae82-4a52-4e0e-87b5-13a5b95cc3a0 => generated 1734 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:41:44.425095 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-4bdcd2c0-1024-41ba-9546-6cadf7375157 tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] 10.222.0.42 "GET /compute/v2.1/servers/8e9cb9c1-7df9-4cb7-9121-54bf74f552c7" status: 200 len: 1357 microversion: 2.1 time: 0.198164 Jun 06 10:41:44.425782 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 223/425] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:41:44 2022] GET /compute/v2.1/servers/8e9cb9c1-7df9-4cb7-9121-54bf74f552c7 => generated 1357 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 10:41:44.758324 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-06889f4a-d6e9-41e2-8406-24b97b635657 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:41:44.759017 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-06889f4a-d6e9-41e2-8406-24b97b635657 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] [instance: 5a0a79a6-8e61-477e-8269-730dfb6d04a6] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:41:44.765063 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-06889f4a-d6e9-41e2-8406-24b97b635657 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:41:44.765503 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-06889f4a-d6e9-41e2-8406-24b97b635657 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:41:44.766268 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-06889f4a-d6e9-41e2-8406-24b97b635657 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:41:44.766698 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-06889f4a-d6e9-41e2-8406-24b97b635657 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:41:44.899912 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-06889f4a-d6e9-41e2-8406-24b97b635657 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:41:44.908221 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-06889f4a-d6e9-41e2-8406-24b97b635657 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:41:44.910337 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-06889f4a-d6e9-41e2-8406-24b97b635657 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:41:44.911412 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-06889f4a-d6e9-41e2-8406-24b97b635657 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0a79a6-8e61-477e-8269-730dfb6d04a6" status: 200 len: 1807 microversion: 2.20 time: 0.157678 Jun 06 10:41:44.912003 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 203/426] 10.222.0.42 () {60 vars in 1276 bytes} [Mon Jun 6 10:41:44 2022] GET /compute/v2.1/servers/5a0a79a6-8e61-477e-8269-730dfb6d04a6 => generated 1807 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 10:41:45.031097 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-708b599a-f329-4809-9c82-a2d5a10b506d tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:41:45.031648 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-708b599a-f329-4809-9c82-a2d5a10b506d tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] [instance: f49079c1-1384-4136-b6cf-eadc40fb5aa1] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:41:45.038751 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-708b599a-f329-4809-9c82-a2d5a10b506d tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:41:45.039200 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-708b599a-f329-4809-9c82-a2d5a10b506d tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:41:45.040000 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-708b599a-f329-4809-9c82-a2d5a10b506d tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:41:45.040440 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-708b599a-f329-4809-9c82-a2d5a10b506d tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:41:45.173366 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-708b599a-f329-4809-9c82-a2d5a10b506d tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b7d82c999646b6b6b96d565f0e3f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe30c756a2f84166ad23af1edf83157e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:41:45.181396 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-708b599a-f329-4809-9c82-a2d5a10b506d tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] 10.222.0.42 "GET /compute/v2.1/servers/f49079c1-1384-4136-b6cf-eadc40fb5aa1" status: 200 len: 1676 microversion: 2.1 time: 0.154263 Jun 06 10:41:45.181959 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 224/427] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:41:45 2022] GET /compute/v2.1/servers/f49079c1-1384-4136-b6cf-eadc40fb5aa1 => generated 1676 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:41:45.439589 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-bd8b95b5-909c-4887-9559-135cb1469457 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:41:45.440225 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-bd8b95b5-909c-4887-9559-135cb1469457 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] [instance: d4d7ae82-4a52-4e0e-87b5-13a5b95cc3a0] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:41:45.441854 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-becee73b-2c4a-4650-9e4b-103f46e82a3b tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:41:45.442466 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-becee73b-2c4a-4650-9e4b-103f46e82a3b tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] [instance: 8e9cb9c1-7df9-4cb7-9121-54bf74f552c7] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:41:45.446991 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-bd8b95b5-909c-4887-9559-135cb1469457 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:41:45.447435 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-bd8b95b5-909c-4887-9559-135cb1469457 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:41:45.448225 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-bd8b95b5-909c-4887-9559-135cb1469457 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:41:45.448422 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-becee73b-2c4a-4650-9e4b-103f46e82a3b tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:41:45.448658 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-bd8b95b5-909c-4887-9559-135cb1469457 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:41:45.448862 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-becee73b-2c4a-4650-9e4b-103f46e82a3b tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:41:45.449619 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-becee73b-2c4a-4650-9e4b-103f46e82a3b tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:41:45.450044 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-becee73b-2c4a-4650-9e4b-103f46e82a3b tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:41:45.650244 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-bd8b95b5-909c-4887-9559-135cb1469457 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f269e146c844480c822347c3a38d103b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2b17b61b73b4e6d81dd8ffe9cf311ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:41:45.655151 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-becee73b-2c4a-4650-9e4b-103f46e82a3b tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7b11ed004fc4ef3a1f1c48adf31fe8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '645eadf589944a24bf6e27326a61952c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:41:45.660829 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-bd8b95b5-909c-4887-9559-135cb1469457 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] 10.222.0.42 "GET /compute/v2.1/servers/d4d7ae82-4a52-4e0e-87b5-13a5b95cc3a0" status: 200 len: 1734 microversion: 2.1 time: 0.224729 Jun 06 10:41:45.662010 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 204/428] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:41:45 2022] GET /compute/v2.1/servers/d4d7ae82-4a52-4e0e-87b5-13a5b95cc3a0 => generated 1734 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:41:45.665945 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-becee73b-2c4a-4650-9e4b-103f46e82a3b tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] 10.222.0.42 "GET /compute/v2.1/servers/8e9cb9c1-7df9-4cb7-9121-54bf74f552c7" status: 200 len: 1357 microversion: 2.1 time: 0.227269 Jun 06 10:41:45.667924 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 225/429] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:41:45 2022] GET /compute/v2.1/servers/8e9cb9c1-7df9-4cb7-9121-54bf74f552c7 => generated 1357 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 10:41:45.676243 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [req-24f4c57c-7638-4c19-89ee-f57935ee8367 req-c3031583-3045-420b-973e-1f88209bc0f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a0a79a6-8e61-477e-8269-730dfb6d04a6", "name": "network-vif-plugged", "status": "completed", "tag": "581fdfa4-6fbc-445e-ad43-e4ef71127c0e"}]} {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 10:41:45.684328 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [req-24f4c57c-7638-4c19-89ee-f57935ee8367 req-c3031583-3045-420b-973e-1f88209bc0f2 service nova] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:41:45.684767 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [req-24f4c57c-7638-4c19-89ee-f57935ee8367 req-c3031583-3045-420b-973e-1f88209bc0f2 service nova] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:41:45.695897 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.compute.server_external_events [req-24f4c57c-7638-4c19-89ee-f57935ee8367 req-c3031583-3045-420b-973e-1f88209bc0f2 service nova] Creating event network-vif-plugged:581fdfa4-6fbc-445e-ad43-e4ef71127c0e for instance 5a0a79a6-8e61-477e-8269-730dfb6d04a6 on hv-cinder-84482 Jun 06 10:41:45.700627 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [req-24f4c57c-7638-4c19-89ee-f57935ee8367 req-c3031583-3045-420b-973e-1f88209bc0f2 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028160 Jun 06 10:41:45.701209 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 205/430] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Jun 6 10:41:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 10:41:45.933459 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-a1cec5ad-60e8-4328-8ae9-3cfd93f96419 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:41:45.935346 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-a1cec5ad-60e8-4328-8ae9-3cfd93f96419 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] [instance: 5a0a79a6-8e61-477e-8269-730dfb6d04a6] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:41:45.944902 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-a1cec5ad-60e8-4328-8ae9-3cfd93f96419 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:41:45.945350 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-a1cec5ad-60e8-4328-8ae9-3cfd93f96419 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:41:45.946115 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-a1cec5ad-60e8-4328-8ae9-3cfd93f96419 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:41:45.948531 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-a1cec5ad-60e8-4328-8ae9-3cfd93f96419 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:41:46.082511 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-a1cec5ad-60e8-4328-8ae9-3cfd93f96419 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:41:46.091139 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-a1cec5ad-60e8-4328-8ae9-3cfd93f96419 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:41:46.092669 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-a1cec5ad-60e8-4328-8ae9-3cfd93f96419 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:41:46.093830 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-a1cec5ad-60e8-4328-8ae9-3cfd93f96419 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0a79a6-8e61-477e-8269-730dfb6d04a6" status: 200 len: 1807 microversion: 2.20 time: 0.164339 Jun 06 10:41:46.094463 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 226/431] 10.222.0.42 () {60 vars in 1276 bytes} [Mon Jun 6 10:41:45 2022] GET /compute/v2.1/servers/5a0a79a6-8e61-477e-8269-730dfb6d04a6 => generated 1807 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 10:41:46.199237 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-3db0336c-e7db-4f48-add6-3eb6c17d94f9 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:41:46.199981 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-3db0336c-e7db-4f48-add6-3eb6c17d94f9 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] [instance: f49079c1-1384-4136-b6cf-eadc40fb5aa1] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:41:46.206299 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-3db0336c-e7db-4f48-add6-3eb6c17d94f9 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:41:46.206797 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-3db0336c-e7db-4f48-add6-3eb6c17d94f9 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:41:46.207666 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-3db0336c-e7db-4f48-add6-3eb6c17d94f9 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:41:46.208129 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-3db0336c-e7db-4f48-add6-3eb6c17d94f9 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:41:46.349892 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-3db0336c-e7db-4f48-add6-3eb6c17d94f9 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b7d82c999646b6b6b96d565f0e3f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe30c756a2f84166ad23af1edf83157e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:41:46.357267 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-3db0336c-e7db-4f48-add6-3eb6c17d94f9 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] 10.222.0.42 "GET /compute/v2.1/servers/f49079c1-1384-4136-b6cf-eadc40fb5aa1" status: 200 len: 1676 microversion: 2.1 time: 0.162508 Jun 06 10:41:46.357823 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 206/432] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:41:46 2022] GET /compute/v2.1/servers/f49079c1-1384-4136-b6cf-eadc40fb5aa1 => generated 1676 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:41:46.678547 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-d8a14c2d-5fe5-42ae-9a4f-c1c742833696 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:41:46.679080 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-d8a14c2d-5fe5-42ae-9a4f-c1c742833696 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] [instance: d4d7ae82-4a52-4e0e-87b5-13a5b95cc3a0] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:41:46.683771 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-e8bfc4bc-d99c-40d4-acca-cda1969f7a8e tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:41:46.684402 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-e8bfc4bc-d99c-40d4-acca-cda1969f7a8e tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] [instance: 8e9cb9c1-7df9-4cb7-9121-54bf74f552c7] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:41:46.685943 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-d8a14c2d-5fe5-42ae-9a4f-c1c742833696 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:41:46.686382 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-d8a14c2d-5fe5-42ae-9a4f-c1c742833696 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:41:46.687149 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-d8a14c2d-5fe5-42ae-9a4f-c1c742833696 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:41:46.687584 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-d8a14c2d-5fe5-42ae-9a4f-c1c742833696 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:41:46.690771 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-e8bfc4bc-d99c-40d4-acca-cda1969f7a8e tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:41:46.691439 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-e8bfc4bc-d99c-40d4-acca-cda1969f7a8e tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:41:46.692227 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-e8bfc4bc-d99c-40d4-acca-cda1969f7a8e tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:41:46.692691 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-e8bfc4bc-d99c-40d4-acca-cda1969f7a8e tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:41:46.883651 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-d8a14c2d-5fe5-42ae-9a4f-c1c742833696 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f269e146c844480c822347c3a38d103b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2b17b61b73b4e6d81dd8ffe9cf311ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:41:46.886853 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-e8bfc4bc-d99c-40d4-acca-cda1969f7a8e tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7b11ed004fc4ef3a1f1c48adf31fe8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '645eadf589944a24bf6e27326a61952c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:41:46.892290 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-d8a14c2d-5fe5-42ae-9a4f-c1c742833696 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] 10.222.0.42 "GET /compute/v2.1/servers/d4d7ae82-4a52-4e0e-87b5-13a5b95cc3a0" status: 200 len: 1734 microversion: 2.1 time: 0.217690 Jun 06 10:41:46.893112 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 227/433] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:41:46 2022] GET /compute/v2.1/servers/d4d7ae82-4a52-4e0e-87b5-13a5b95cc3a0 => generated 1734 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:41:46.894385 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-e8bfc4bc-d99c-40d4-acca-cda1969f7a8e tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] 10.222.0.42 "GET /compute/v2.1/servers/8e9cb9c1-7df9-4cb7-9121-54bf74f552c7" status: 200 len: 1357 microversion: 2.1 time: 0.214958 Jun 06 10:41:46.894931 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 207/434] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:41:46 2022] GET /compute/v2.1/servers/8e9cb9c1-7df9-4cb7-9121-54bf74f552c7 => generated 1357 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 10:41:47.113413 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-8b12af6f-8396-4d05-8717-a74cd6c2a4ee tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:41:47.114442 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-8b12af6f-8396-4d05-8717-a74cd6c2a4ee tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] [instance: 5a0a79a6-8e61-477e-8269-730dfb6d04a6] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:41:47.121266 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-8b12af6f-8396-4d05-8717-a74cd6c2a4ee tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:41:47.121706 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-8b12af6f-8396-4d05-8717-a74cd6c2a4ee tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:41:47.122455 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-8b12af6f-8396-4d05-8717-a74cd6c2a4ee tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:41:47.122889 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-8b12af6f-8396-4d05-8717-a74cd6c2a4ee tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:41:47.264794 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-8b12af6f-8396-4d05-8717-a74cd6c2a4ee tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:41:47.273630 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-8b12af6f-8396-4d05-8717-a74cd6c2a4ee tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:41:47.275133 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-8b12af6f-8396-4d05-8717-a74cd6c2a4ee tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:41:47.276322 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-8b12af6f-8396-4d05-8717-a74cd6c2a4ee tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0a79a6-8e61-477e-8269-730dfb6d04a6" status: 200 len: 1807 microversion: 2.20 time: 0.167836 Jun 06 10:41:47.276884 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 228/435] 10.222.0.42 () {60 vars in 1276 bytes} [Mon Jun 6 10:41:47 2022] GET /compute/v2.1/servers/5a0a79a6-8e61-477e-8269-730dfb6d04a6 => generated 1807 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 10:41:47.374538 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-346e5b2b-8668-4369-9238-48dea319dcea tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:41:47.375072 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-346e5b2b-8668-4369-9238-48dea319dcea tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] [instance: f49079c1-1384-4136-b6cf-eadc40fb5aa1] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:41:47.381359 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-346e5b2b-8668-4369-9238-48dea319dcea tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:41:47.381828 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-346e5b2b-8668-4369-9238-48dea319dcea tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:41:47.382584 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-346e5b2b-8668-4369-9238-48dea319dcea tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:41:47.383016 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-346e5b2b-8668-4369-9238-48dea319dcea tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:41:47.512936 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-346e5b2b-8668-4369-9238-48dea319dcea tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b7d82c999646b6b6b96d565f0e3f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe30c756a2f84166ad23af1edf83157e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:41:47.521174 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-346e5b2b-8668-4369-9238-48dea319dcea tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] 10.222.0.42 "GET /compute/v2.1/servers/f49079c1-1384-4136-b6cf-eadc40fb5aa1" status: 200 len: 1676 microversion: 2.1 time: 0.150549 Jun 06 10:41:47.521734 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 208/436] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:41:47 2022] GET /compute/v2.1/servers/f49079c1-1384-4136-b6cf-eadc40fb5aa1 => generated 1676 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:41:47.909523 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-ac66794d-b476-4eec-a12d-6a17ac747beb tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:41:47.910088 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-ac66794d-b476-4eec-a12d-6a17ac747beb tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] [instance: d4d7ae82-4a52-4e0e-87b5-13a5b95cc3a0] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:41:47.910213 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-2e131122-8214-4747-a248-b341be4dc9bd tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:41:47.910808 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-2e131122-8214-4747-a248-b341be4dc9bd tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] [instance: 8e9cb9c1-7df9-4cb7-9121-54bf74f552c7] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:41:47.916192 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-ac66794d-b476-4eec-a12d-6a17ac747beb tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:41:47.916636 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-ac66794d-b476-4eec-a12d-6a17ac747beb tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:41:47.917150 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-2e131122-8214-4747-a248-b341be4dc9bd tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:41:47.917399 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-ac66794d-b476-4eec-a12d-6a17ac747beb tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:41:47.917598 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-2e131122-8214-4747-a248-b341be4dc9bd tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:41:47.917831 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-ac66794d-b476-4eec-a12d-6a17ac747beb tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:41:47.918358 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-2e131122-8214-4747-a248-b341be4dc9bd tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:41:47.918789 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-2e131122-8214-4747-a248-b341be4dc9bd tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:41:48.122638 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-2e131122-8214-4747-a248-b341be4dc9bd tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7b11ed004fc4ef3a1f1c48adf31fe8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '645eadf589944a24bf6e27326a61952c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:41:48.130553 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-2e131122-8214-4747-a248-b341be4dc9bd tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] 10.222.0.42 "GET /compute/v2.1/servers/8e9cb9c1-7df9-4cb7-9121-54bf74f552c7" status: 200 len: 1357 microversion: 2.1 time: 0.224158 Jun 06 10:41:48.131131 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 209/437] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:41:47 2022] GET /compute/v2.1/servers/8e9cb9c1-7df9-4cb7-9121-54bf74f552c7 => generated 1357 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 10:41:48.132077 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-ac66794d-b476-4eec-a12d-6a17ac747beb tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f269e146c844480c822347c3a38d103b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2b17b61b73b4e6d81dd8ffe9cf311ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:41:48.143024 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-ac66794d-b476-4eec-a12d-6a17ac747beb tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] 10.222.0.42 "GET /compute/v2.1/servers/d4d7ae82-4a52-4e0e-87b5-13a5b95cc3a0" status: 200 len: 1734 microversion: 2.1 time: 0.237078 Jun 06 10:41:48.149035 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 229/438] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:41:47 2022] GET /compute/v2.1/servers/d4d7ae82-4a52-4e0e-87b5-13a5b95cc3a0 => generated 1734 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:41:48.295194 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-088cab00-fae9-4080-a262-3ddd637df2c2 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:41:48.295827 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-088cab00-fae9-4080-a262-3ddd637df2c2 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] [instance: 5a0a79a6-8e61-477e-8269-730dfb6d04a6] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:41:48.303134 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-088cab00-fae9-4080-a262-3ddd637df2c2 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:41:48.304075 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-088cab00-fae9-4080-a262-3ddd637df2c2 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:41:48.304853 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-088cab00-fae9-4080-a262-3ddd637df2c2 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:41:48.305282 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-088cab00-fae9-4080-a262-3ddd637df2c2 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:41:48.446905 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-088cab00-fae9-4080-a262-3ddd637df2c2 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:41:48.455576 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-088cab00-fae9-4080-a262-3ddd637df2c2 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:41:48.457269 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-088cab00-fae9-4080-a262-3ddd637df2c2 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:41:48.458526 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-088cab00-fae9-4080-a262-3ddd637df2c2 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0a79a6-8e61-477e-8269-730dfb6d04a6" status: 200 len: 1807 microversion: 2.20 time: 0.168102 Jun 06 10:41:48.459082 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 210/439] 10.222.0.42 () {60 vars in 1276 bytes} [Mon Jun 6 10:41:48 2022] GET /compute/v2.1/servers/5a0a79a6-8e61-477e-8269-730dfb6d04a6 => generated 1807 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 10:41:48.538248 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-69f2f761-e884-4983-814c-5dad62a568a2 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:41:48.538860 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-69f2f761-e884-4983-814c-5dad62a568a2 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] [instance: f49079c1-1384-4136-b6cf-eadc40fb5aa1] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:41:48.544944 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-69f2f761-e884-4983-814c-5dad62a568a2 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:41:48.545792 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-69f2f761-e884-4983-814c-5dad62a568a2 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:41:48.546679 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-69f2f761-e884-4983-814c-5dad62a568a2 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:41:48.547341 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-69f2f761-e884-4983-814c-5dad62a568a2 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:41:48.684133 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-69f2f761-e884-4983-814c-5dad62a568a2 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b7d82c999646b6b6b96d565f0e3f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe30c756a2f84166ad23af1edf83157e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:41:48.691687 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-69f2f761-e884-4983-814c-5dad62a568a2 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] 10.222.0.42 "GET /compute/v2.1/servers/f49079c1-1384-4136-b6cf-eadc40fb5aa1" status: 200 len: 1676 microversion: 2.1 time: 0.157331 Jun 06 10:41:48.692288 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 230/440] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:41:48 2022] GET /compute/v2.1/servers/f49079c1-1384-4136-b6cf-eadc40fb5aa1 => generated 1676 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:41:49.147943 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-f515d8ff-e910-45c6-918a-bc3d4e308acf tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:41:49.148461 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-f515d8ff-e910-45c6-918a-bc3d4e308acf tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] [instance: 8e9cb9c1-7df9-4cb7-9121-54bf74f552c7] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:41:49.154843 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-f515d8ff-e910-45c6-918a-bc3d4e308acf tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:41:49.155286 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-f515d8ff-e910-45c6-918a-bc3d4e308acf tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:41:49.156059 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-f515d8ff-e910-45c6-918a-bc3d4e308acf tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:41:49.156494 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-f515d8ff-e910-45c6-918a-bc3d4e308acf tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:41:49.160764 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-198e14b6-44b1-4c88-8b67-f8fcbe091908 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:41:49.161385 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-198e14b6-44b1-4c88-8b67-f8fcbe091908 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] [instance: d4d7ae82-4a52-4e0e-87b5-13a5b95cc3a0] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:41:49.167774 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-198e14b6-44b1-4c88-8b67-f8fcbe091908 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:41:49.168273 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-198e14b6-44b1-4c88-8b67-f8fcbe091908 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:41:49.169049 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-198e14b6-44b1-4c88-8b67-f8fcbe091908 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:41:49.169484 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-198e14b6-44b1-4c88-8b67-f8fcbe091908 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:41:49.355301 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-f515d8ff-e910-45c6-918a-bc3d4e308acf tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7b11ed004fc4ef3a1f1c48adf31fe8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '645eadf589944a24bf6e27326a61952c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:41:49.362127 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-198e14b6-44b1-4c88-8b67-f8fcbe091908 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f269e146c844480c822347c3a38d103b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2b17b61b73b4e6d81dd8ffe9cf311ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:41:49.362681 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-f515d8ff-e910-45c6-918a-bc3d4e308acf tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] 10.222.0.42 "GET /compute/v2.1/servers/8e9cb9c1-7df9-4cb7-9121-54bf74f552c7" status: 200 len: 1357 microversion: 2.1 time: 0.219117 Jun 06 10:41:49.363251 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 211/441] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:41:49 2022] GET /compute/v2.1/servers/8e9cb9c1-7df9-4cb7-9121-54bf74f552c7 => generated 1357 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:41:49.370574 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-198e14b6-44b1-4c88-8b67-f8fcbe091908 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] 10.222.0.42 "GET /compute/v2.1/servers/d4d7ae82-4a52-4e0e-87b5-13a5b95cc3a0" status: 200 len: 1734 microversion: 2.1 time: 0.214278 Jun 06 10:41:49.371125 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 231/442] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:41:49 2022] GET /compute/v2.1/servers/d4d7ae82-4a52-4e0e-87b5-13a5b95cc3a0 => generated 1734 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 10:41:49.476774 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-82932eaf-2d25-4025-80f5-ad7adadfef3c tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:41:49.477377 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-82932eaf-2d25-4025-80f5-ad7adadfef3c tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] [instance: 5a0a79a6-8e61-477e-8269-730dfb6d04a6] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:41:49.483248 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-82932eaf-2d25-4025-80f5-ad7adadfef3c tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:41:49.483687 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-82932eaf-2d25-4025-80f5-ad7adadfef3c tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:41:49.484467 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-82932eaf-2d25-4025-80f5-ad7adadfef3c tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:41:49.484893 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-82932eaf-2d25-4025-80f5-ad7adadfef3c tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:41:49.499432 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG dbcounter [-] [129350] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=129350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 10:41:49.616030 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-82932eaf-2d25-4025-80f5-ad7adadfef3c tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:41:49.624453 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-82932eaf-2d25-4025-80f5-ad7adadfef3c tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:41:49.625959 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-82932eaf-2d25-4025-80f5-ad7adadfef3c tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:41:49.627107 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-82932eaf-2d25-4025-80f5-ad7adadfef3c tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0a79a6-8e61-477e-8269-730dfb6d04a6" status: 200 len: 1794 microversion: 2.20 time: 0.154255 Jun 06 10:41:49.627655 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 212/443] 10.222.0.42 () {60 vars in 1276 bytes} [Mon Jun 6 10:41:49 2022] GET /compute/v2.1/servers/5a0a79a6-8e61-477e-8269-730dfb6d04a6 => generated 1794 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 10:41:49.694658 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [req-47966f39-552a-43ca-843f-383b59fb5d4c req-f2a0fdb2-1d11-4ccb-a9ed-d2dfb750ec6f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e9cb9c1-7df9-4cb7-9121-54bf74f552c7", "name": "network-vif-plugged", "status": "completed", "tag": "d50634ea-b30b-4bd6-b547-ee82d39a4a57"}]} {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 10:41:49.702807 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [req-47966f39-552a-43ca-843f-383b59fb5d4c req-f2a0fdb2-1d11-4ccb-a9ed-d2dfb750ec6f service nova] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:41:49.703253 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [req-47966f39-552a-43ca-843f-383b59fb5d4c req-f2a0fdb2-1d11-4ccb-a9ed-d2dfb750ec6f service nova] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:41:49.713047 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-21a4a850-1b18-443e-a05c-f479d2abab92 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:41:49.714913 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-21a4a850-1b18-443e-a05c-f479d2abab92 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] [instance: f49079c1-1384-4136-b6cf-eadc40fb5aa1] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:41:49.717405 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.compute.server_external_events [req-47966f39-552a-43ca-843f-383b59fb5d4c req-f2a0fdb2-1d11-4ccb-a9ed-d2dfb750ec6f service nova] Creating event network-vif-plugged:d50634ea-b30b-4bd6-b547-ee82d39a4a57 for instance 8e9cb9c1-7df9-4cb7-9121-54bf74f552c7 on hv-cinder-84482 Jun 06 10:41:49.720648 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-21a4a850-1b18-443e-a05c-f479d2abab92 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:41:49.721099 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-21a4a850-1b18-443e-a05c-f479d2abab92 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:41:49.721877 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-21a4a850-1b18-443e-a05c-f479d2abab92 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:41:49.722370 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-21a4a850-1b18-443e-a05c-f479d2abab92 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:41:49.722880 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [req-47966f39-552a-43ca-843f-383b59fb5d4c req-f2a0fdb2-1d11-4ccb-a9ed-d2dfb750ec6f service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031970 Jun 06 10:41:49.723930 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 232/444] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Jun 6 10:41:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 10:41:49.872129 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-21a4a850-1b18-443e-a05c-f479d2abab92 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b7d82c999646b6b6b96d565f0e3f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe30c756a2f84166ad23af1edf83157e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:41:49.880361 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-21a4a850-1b18-443e-a05c-f479d2abab92 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] 10.222.0.42 "GET /compute/v2.1/servers/f49079c1-1384-4136-b6cf-eadc40fb5aa1" status: 200 len: 1676 microversion: 2.1 time: 0.171434 Jun 06 10:41:49.880961 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 213/445] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:41:49 2022] GET /compute/v2.1/servers/f49079c1-1384-4136-b6cf-eadc40fb5aa1 => generated 1676 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 10:41:50.382059 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-c207e514-b413-47e0-b028-939182641303 tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:41:50.383381 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-c207e514-b413-47e0-b028-939182641303 tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] [instance: 8e9cb9c1-7df9-4cb7-9121-54bf74f552c7] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:41:50.389792 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-d8551e72-9bb0-4541-929c-4c95c8791289 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:41:50.390311 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-c207e514-b413-47e0-b028-939182641303 tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:41:50.390423 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-d8551e72-9bb0-4541-929c-4c95c8791289 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] [instance: d4d7ae82-4a52-4e0e-87b5-13a5b95cc3a0] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:41:50.390755 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-c207e514-b413-47e0-b028-939182641303 tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:41:50.391520 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-c207e514-b413-47e0-b028-939182641303 tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:41:50.391981 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-c207e514-b413-47e0-b028-939182641303 tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:41:50.397041 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-d8551e72-9bb0-4541-929c-4c95c8791289 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:41:50.397496 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-d8551e72-9bb0-4541-929c-4c95c8791289 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:41:50.398232 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-d8551e72-9bb0-4541-929c-4c95c8791289 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:41:50.398657 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-d8551e72-9bb0-4541-929c-4c95c8791289 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:41:50.588847 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-c207e514-b413-47e0-b028-939182641303 tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7b11ed004fc4ef3a1f1c48adf31fe8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '645eadf589944a24bf6e27326a61952c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:41:50.592961 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-d8551e72-9bb0-4541-929c-4c95c8791289 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f269e146c844480c822347c3a38d103b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2b17b61b73b4e6d81dd8ffe9cf311ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:41:50.596194 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-c207e514-b413-47e0-b028-939182641303 tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] 10.222.0.42 "GET /compute/v2.1/servers/8e9cb9c1-7df9-4cb7-9121-54bf74f552c7" status: 200 len: 1357 microversion: 2.1 time: 0.220482 Jun 06 10:41:50.596990 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 233/446] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:41:50 2022] GET /compute/v2.1/servers/8e9cb9c1-7df9-4cb7-9121-54bf74f552c7 => generated 1357 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:41:50.601711 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-d8551e72-9bb0-4541-929c-4c95c8791289 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] 10.222.0.42 "GET /compute/v2.1/servers/d4d7ae82-4a52-4e0e-87b5-13a5b95cc3a0" status: 200 len: 1734 microversion: 2.1 time: 0.215799 Jun 06 10:41:50.602374 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 214/447] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:41:50 2022] GET /compute/v2.1/servers/d4d7ae82-4a52-4e0e-87b5-13a5b95cc3a0 => generated 1734 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:41:50.897697 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-89bef722-f1e9-483a-aa56-6f8129fdad1c tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:41:50.898272 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-89bef722-f1e9-483a-aa56-6f8129fdad1c tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] [instance: f49079c1-1384-4136-b6cf-eadc40fb5aa1] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:41:50.904279 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-89bef722-f1e9-483a-aa56-6f8129fdad1c tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:41:50.904726 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-89bef722-f1e9-483a-aa56-6f8129fdad1c tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:41:50.905487 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-89bef722-f1e9-483a-aa56-6f8129fdad1c tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:41:50.905945 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-89bef722-f1e9-483a-aa56-6f8129fdad1c tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:41:51.037525 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-89bef722-f1e9-483a-aa56-6f8129fdad1c tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b7d82c999646b6b6b96d565f0e3f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe30c756a2f84166ad23af1edf83157e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:41:51.044948 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-89bef722-f1e9-483a-aa56-6f8129fdad1c tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] 10.222.0.42 "GET /compute/v2.1/servers/f49079c1-1384-4136-b6cf-eadc40fb5aa1" status: 200 len: 1676 microversion: 2.1 time: 0.151884 Jun 06 10:41:51.045506 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 234/448] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:41:50 2022] GET /compute/v2.1/servers/f49079c1-1384-4136-b6cf-eadc40fb5aa1 => generated 1676 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:41:51.614415 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-f41c655d-0c62-430f-bf9e-c6993df75031 tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:41:51.615022 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-f41c655d-0c62-430f-bf9e-c6993df75031 tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] [instance: 8e9cb9c1-7df9-4cb7-9121-54bf74f552c7] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:41:51.619638 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-06da7844-721c-4773-bbd4-e351d4fbf76b tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:41:51.620383 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-06da7844-721c-4773-bbd4-e351d4fbf76b tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] [instance: d4d7ae82-4a52-4e0e-87b5-13a5b95cc3a0] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:41:51.621499 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-f41c655d-0c62-430f-bf9e-c6993df75031 tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:41:51.621947 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-f41c655d-0c62-430f-bf9e-c6993df75031 tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:41:51.622703 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-f41c655d-0c62-430f-bf9e-c6993df75031 tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:41:51.623129 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-f41c655d-0c62-430f-bf9e-c6993df75031 tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:41:51.627096 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-06da7844-721c-4773-bbd4-e351d4fbf76b tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:41:51.627550 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-06da7844-721c-4773-bbd4-e351d4fbf76b tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:41:51.628954 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-06da7844-721c-4773-bbd4-e351d4fbf76b tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:41:51.629409 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-06da7844-721c-4773-bbd4-e351d4fbf76b tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:41:51.817581 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-f41c655d-0c62-430f-bf9e-c6993df75031 tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7b11ed004fc4ef3a1f1c48adf31fe8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '645eadf589944a24bf6e27326a61952c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:41:51.823961 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-06da7844-721c-4773-bbd4-e351d4fbf76b tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f269e146c844480c822347c3a38d103b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2b17b61b73b4e6d81dd8ffe9cf311ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:41:51.824946 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-f41c655d-0c62-430f-bf9e-c6993df75031 tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] 10.222.0.42 "GET /compute/v2.1/servers/8e9cb9c1-7df9-4cb7-9121-54bf74f552c7" status: 200 len: 1548 microversion: 2.1 time: 0.215224 Jun 06 10:41:51.825516 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 215/449] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:41:51 2022] GET /compute/v2.1/servers/8e9cb9c1-7df9-4cb7-9121-54bf74f552c7 => generated 1548 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:41:51.832170 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-06da7844-721c-4773-bbd4-e351d4fbf76b tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] 10.222.0.42 "GET /compute/v2.1/servers/d4d7ae82-4a52-4e0e-87b5-13a5b95cc3a0" status: 200 len: 1734 microversion: 2.1 time: 0.216381 Jun 06 10:41:51.832727 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 235/450] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:41:51 2022] GET /compute/v2.1/servers/d4d7ae82-4a52-4e0e-87b5-13a5b95cc3a0 => generated 1734 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 10:41:51.841393 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-b636ff92-473f-470b-a37c-d534b7d02f98 tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:41:51.841996 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-b636ff92-473f-470b-a37c-d534b7d02f98 tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] [instance: 8e9cb9c1-7df9-4cb7-9121-54bf74f552c7] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:41:51.848867 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-b636ff92-473f-470b-a37c-d534b7d02f98 tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:41:51.849308 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-b636ff92-473f-470b-a37c-d534b7d02f98 tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:41:51.850060 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-b636ff92-473f-470b-a37c-d534b7d02f98 tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:41:51.850492 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-b636ff92-473f-470b-a37c-d534b7d02f98 tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:41:51.980950 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-b636ff92-473f-470b-a37c-d534b7d02f98 tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7b11ed004fc4ef3a1f1c48adf31fe8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '645eadf589944a24bf6e27326a61952c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:41:51.989108 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-b636ff92-473f-470b-a37c-d534b7d02f98 tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] 10.222.0.42 "GET /compute/v2.1/servers/8e9cb9c1-7df9-4cb7-9121-54bf74f552c7" status: 200 len: 1548 microversion: 2.1 time: 0.151491 Jun 06 10:41:51.989606 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 216/451] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:41:51 2022] GET /compute/v2.1/servers/8e9cb9c1-7df9-4cb7-9121-54bf74f552c7 => generated 1548 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:41:52.004813 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-89e4280d-5856-4e66-9d72-e14a6a60516a tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:41:52.008302 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-89e4280d-5856-4e66-9d72-e14a6a60516a tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b7b11ed004fc4ef3a1f1c48adf31fe8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '645eadf589944a24bf6e27326a61952c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:41:52.009088 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-89e4280d-5856-4e66-9d72-e14a6a60516a tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Searching by: {'deleted': False, 'project_id': '645eadf589944a24bf6e27326a61952c'} {{(pid=129349) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 06 10:41:52.015607 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-89e4280d-5856-4e66-9d72-e14a6a60516a tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:41:52.016081 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-89e4280d-5856-4e66-9d72-e14a6a60516a tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:41:52.016863 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-89e4280d-5856-4e66-9d72-e14a6a60516a tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:41:52.017288 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-89e4280d-5856-4e66-9d72-e14a6a60516a tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:41:52.060974 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-a1860d0c-bc9e-4cff-8819-bd2d7d0158d2 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:41:52.061586 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-a1860d0c-bc9e-4cff-8819-bd2d7d0158d2 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] [instance: f49079c1-1384-4136-b6cf-eadc40fb5aa1] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:41:52.067488 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-a1860d0c-bc9e-4cff-8819-bd2d7d0158d2 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:41:52.067981 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-a1860d0c-bc9e-4cff-8819-bd2d7d0158d2 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:41:52.068771 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-a1860d0c-bc9e-4cff-8819-bd2d7d0158d2 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:41:52.069208 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-a1860d0c-bc9e-4cff-8819-bd2d7d0158d2 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:41:52.109368 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.multi_cell_list [None req-89e4280d-5856-4e66-9d72-e14a6a60516a tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=129349) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 06 10:41:52.198488 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-a1860d0c-bc9e-4cff-8819-bd2d7d0158d2 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b7d82c999646b6b6b96d565f0e3f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe30c756a2f84166ad23af1edf83157e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:41:52.205858 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-a1860d0c-bc9e-4cff-8819-bd2d7d0158d2 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] 10.222.0.42 "GET /compute/v2.1/servers/f49079c1-1384-4136-b6cf-eadc40fb5aa1" status: 200 len: 1676 microversion: 2.1 time: 0.148658 Jun 06 10:41:52.206971 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 217/452] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:41:52 2022] GET /compute/v2.1/servers/f49079c1-1384-4136-b6cf-eadc40fb5aa1 => generated 1676 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 10:41:52.207626 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-89e4280d-5856-4e66-9d72-e14a6a60516a tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] 10.222.0.42 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.206960 Jun 06 10:41:52.208330 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 236/453] 10.222.0.42 () {58 vars in 1124 bytes} [Mon Jun 6 10:41:51 2022] GET /compute/v2.1/servers => generated 342 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 10:41:52.217979 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-9891dc7d-947a-4fe1-a359-cc15355f955c tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:41:52.218588 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-9891dc7d-947a-4fe1-a359-cc15355f955c tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] [instance: 8e9cb9c1-7df9-4cb7-9121-54bf74f552c7] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:41:52.225113 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-9891dc7d-947a-4fe1-a359-cc15355f955c tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:41:52.225563 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-9891dc7d-947a-4fe1-a359-cc15355f955c tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:41:52.226328 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-9891dc7d-947a-4fe1-a359-cc15355f955c tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:41:52.226763 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-9891dc7d-947a-4fe1-a359-cc15355f955c tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:41:52.360082 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-9891dc7d-947a-4fe1-a359-cc15355f955c tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7b11ed004fc4ef3a1f1c48adf31fe8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '645eadf589944a24bf6e27326a61952c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:41:52.367772 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-9891dc7d-947a-4fe1-a359-cc15355f955c tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] 10.222.0.42 "GET /compute/v2.1/servers/8e9cb9c1-7df9-4cb7-9121-54bf74f552c7" status: 200 len: 1548 microversion: 2.1 time: 0.153304 Jun 06 10:41:52.368351 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 218/454] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:41:52 2022] GET /compute/v2.1/servers/8e9cb9c1-7df9-4cb7-9121-54bf74f552c7 => generated 1548 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 10:41:52.849340 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-3e0c69cd-98f3-4fe5-81b2-04a58b340c73 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:41:52.849869 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-3e0c69cd-98f3-4fe5-81b2-04a58b340c73 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] [instance: d4d7ae82-4a52-4e0e-87b5-13a5b95cc3a0] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:41:52.856587 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-3e0c69cd-98f3-4fe5-81b2-04a58b340c73 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:41:52.857036 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-3e0c69cd-98f3-4fe5-81b2-04a58b340c73 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:41:52.857814 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-3e0c69cd-98f3-4fe5-81b2-04a58b340c73 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:41:52.858256 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-3e0c69cd-98f3-4fe5-81b2-04a58b340c73 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:41:52.989788 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-3e0c69cd-98f3-4fe5-81b2-04a58b340c73 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f269e146c844480c822347c3a38d103b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2b17b61b73b4e6d81dd8ffe9cf311ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:41:52.997795 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-3e0c69cd-98f3-4fe5-81b2-04a58b340c73 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] 10.222.0.42 "GET /compute/v2.1/servers/d4d7ae82-4a52-4e0e-87b5-13a5b95cc3a0" status: 200 len: 1734 microversion: 2.1 time: 0.152447 Jun 06 10:41:52.998357 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 237/455] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:41:52 2022] GET /compute/v2.1/servers/d4d7ae82-4a52-4e0e-87b5-13a5b95cc3a0 => generated 1734 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:41:53.224585 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-d65ebf36-c3d1-4e1f-a517-e2cf22d6bffe tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:41:53.225187 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-d65ebf36-c3d1-4e1f-a517-e2cf22d6bffe tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] [instance: f49079c1-1384-4136-b6cf-eadc40fb5aa1] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:41:53.231614 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-d65ebf36-c3d1-4e1f-a517-e2cf22d6bffe tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:41:53.232073 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-d65ebf36-c3d1-4e1f-a517-e2cf22d6bffe tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:41:53.232828 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-d65ebf36-c3d1-4e1f-a517-e2cf22d6bffe tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:41:53.233256 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-d65ebf36-c3d1-4e1f-a517-e2cf22d6bffe tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:41:53.359679 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-d65ebf36-c3d1-4e1f-a517-e2cf22d6bffe tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b7d82c999646b6b6b96d565f0e3f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe30c756a2f84166ad23af1edf83157e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:41:53.367879 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-d65ebf36-c3d1-4e1f-a517-e2cf22d6bffe tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] 10.222.0.42 "GET /compute/v2.1/servers/f49079c1-1384-4136-b6cf-eadc40fb5aa1" status: 200 len: 1676 microversion: 2.1 time: 0.147807 Jun 06 10:41:53.368432 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 219/456] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:41:53 2022] GET /compute/v2.1/servers/f49079c1-1384-4136-b6cf-eadc40fb5aa1 => generated 1676 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:41:53.879166 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-bab72f46-1d9b-4e52-b2fe-8725473d95ec tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3502fd35-e3c6-41c9-8986-b7f22033a0e6"}} {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 10:41:53.880262 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-bab72f46-1d9b-4e52-b2fe-8725473d95ec tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] [instance: 8e9cb9c1-7df9-4cb7-9121-54bf74f552c7] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:41:53.886711 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-bab72f46-1d9b-4e52-b2fe-8725473d95ec tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:41:53.887149 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-bab72f46-1d9b-4e52-b2fe-8725473d95ec tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:41:53.887923 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-bab72f46-1d9b-4e52-b2fe-8725473d95ec tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:41:53.888349 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-bab72f46-1d9b-4e52-b2fe-8725473d95ec tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:41:53.905700 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG dbcounter [-] [129349] Writing DB stats nova_cell1:SELECT=100 {{(pid=129349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 10:41:54.015836 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-14d2e89b-517a-4145-9f14-77970412f033 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:41:54.016593 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-14d2e89b-517a-4145-9f14-77970412f033 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] [instance: d4d7ae82-4a52-4e0e-87b5-13a5b95cc3a0] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:41:54.023619 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-14d2e89b-517a-4145-9f14-77970412f033 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:41:54.024097 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-14d2e89b-517a-4145-9f14-77970412f033 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:41:54.024868 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-14d2e89b-517a-4145-9f14-77970412f033 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:41:54.025305 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-14d2e89b-517a-4145-9f14-77970412f033 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:41:54.157903 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-14d2e89b-517a-4145-9f14-77970412f033 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f269e146c844480c822347c3a38d103b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2b17b61b73b4e6d81dd8ffe9cf311ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:41:54.167616 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-14d2e89b-517a-4145-9f14-77970412f033 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] 10.222.0.42 "GET /compute/v2.1/servers/d4d7ae82-4a52-4e0e-87b5-13a5b95cc3a0" status: 200 len: 1734 microversion: 2.1 time: 0.155591 Jun 06 10:41:54.168238 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 220/457] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:41:54 2022] GET /compute/v2.1/servers/d4d7ae82-4a52-4e0e-87b5-13a5b95cc3a0 => generated 1734 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 10:41:54.289691 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-bab72f46-1d9b-4e52-b2fe-8725473d95ec tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] 10.222.0.42 "POST /compute/v2.1/servers/8e9cb9c1-7df9-4cb7-9121-54bf74f552c7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.415311 Jun 06 10:41:54.290292 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 238/458] 10.222.0.42 () {60 vars in 1322 bytes} [Mon Jun 6 10:41:53 2022] POST /compute/v2.1/servers/8e9cb9c1-7df9-4cb7-9121-54bf74f552c7/os-volume_attachments => generated 194 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 10:41:54.384953 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-e49b172e-4d1c-4b37-b0e0-2ebd523ea1de tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:41:54.385781 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-e49b172e-4d1c-4b37-b0e0-2ebd523ea1de tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] [instance: f49079c1-1384-4136-b6cf-eadc40fb5aa1] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:41:54.392828 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-e49b172e-4d1c-4b37-b0e0-2ebd523ea1de tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:41:54.393270 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-e49b172e-4d1c-4b37-b0e0-2ebd523ea1de tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:41:54.394103 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-e49b172e-4d1c-4b37-b0e0-2ebd523ea1de tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:41:54.394533 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-e49b172e-4d1c-4b37-b0e0-2ebd523ea1de tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:41:54.523196 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-e49b172e-4d1c-4b37-b0e0-2ebd523ea1de tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b7d82c999646b6b6b96d565f0e3f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe30c756a2f84166ad23af1edf83157e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:41:54.530679 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-e49b172e-4d1c-4b37-b0e0-2ebd523ea1de tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] 10.222.0.42 "GET /compute/v2.1/servers/f49079c1-1384-4136-b6cf-eadc40fb5aa1" status: 200 len: 1653 microversion: 2.1 time: 0.149559 Jun 06 10:41:54.531234 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 221/459] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:41:54 2022] GET /compute/v2.1/servers/f49079c1-1384-4136-b6cf-eadc40fb5aa1 => generated 1653 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:41:54.547748 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-40e5aea9-23d5-4e63-a011-c8ce4b7deb68 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 10:41:54.555405 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-40e5aea9-23d5-4e63-a011-c8ce4b7deb68 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:41:54.555899 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-40e5aea9-23d5-4e63-a011-c8ce4b7deb68 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:41:54.577680 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-40e5aea9-23d5-4e63-a011-c8ce4b7deb68 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] [instance: f49079c1-1384-4136-b6cf-eadc40fb5aa1] Going to try to start instance {{(pid=129349) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 06 10:41:54.619008 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-40e5aea9-23d5-4e63-a011-c8ce4b7deb68 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] 10.222.0.42 "POST /compute/v2.1/servers/f49079c1-1384-4136-b6cf-eadc40fb5aa1/action" status: 202 len: 0 microversion: 2.1 time: 0.075747 Jun 06 10:41:54.619571 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 239/460] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Jun 6 10:41:54 2022] POST /compute/v2.1/servers/f49079c1-1384-4136-b6cf-eadc40fb5aa1/action => generated 0 bytes in 77 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 06 10:41:54.627517 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-e4a4367b-5354-49a6-84c1-f230be1b2f3a tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:41:54.628751 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-e4a4367b-5354-49a6-84c1-f230be1b2f3a tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] [instance: f49079c1-1384-4136-b6cf-eadc40fb5aa1] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:41:54.635332 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-e4a4367b-5354-49a6-84c1-f230be1b2f3a tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:41:54.635775 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-e4a4367b-5354-49a6-84c1-f230be1b2f3a tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:41:54.636624 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-e4a4367b-5354-49a6-84c1-f230be1b2f3a tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:41:54.637138 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-e4a4367b-5354-49a6-84c1-f230be1b2f3a tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:41:54.858350 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-e4a4367b-5354-49a6-84c1-f230be1b2f3a tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b7d82c999646b6b6b96d565f0e3f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe30c756a2f84166ad23af1edf83157e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:41:54.865941 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-e4a4367b-5354-49a6-84c1-f230be1b2f3a tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] 10.222.0.42 "GET /compute/v2.1/servers/f49079c1-1384-4136-b6cf-eadc40fb5aa1" status: 200 len: 1662 microversion: 2.1 time: 0.242143 Jun 06 10:41:54.866498 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 222/461] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:41:54 2022] GET /compute/v2.1/servers/f49079c1-1384-4136-b6cf-eadc40fb5aa1 => generated 1662 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:41:55.186875 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-97ef6949-d804-4768-9147-675f92df3ad2 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:41:55.187580 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-97ef6949-d804-4768-9147-675f92df3ad2 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] [instance: d4d7ae82-4a52-4e0e-87b5-13a5b95cc3a0] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:41:55.194707 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-97ef6949-d804-4768-9147-675f92df3ad2 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:41:55.195162 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-97ef6949-d804-4768-9147-675f92df3ad2 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:41:55.195970 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-97ef6949-d804-4768-9147-675f92df3ad2 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:41:55.196413 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-97ef6949-d804-4768-9147-675f92df3ad2 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:41:55.407580 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-97ef6949-d804-4768-9147-675f92df3ad2 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f269e146c844480c822347c3a38d103b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2b17b61b73b4e6d81dd8ffe9cf311ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:41:55.415951 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-97ef6949-d804-4768-9147-675f92df3ad2 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] 10.222.0.42 "GET /compute/v2.1/servers/d4d7ae82-4a52-4e0e-87b5-13a5b95cc3a0" status: 200 len: 1734 microversion: 2.1 time: 0.233933 Jun 06 10:41:55.416514 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 240/462] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:41:55 2022] GET /compute/v2.1/servers/d4d7ae82-4a52-4e0e-87b5-13a5b95cc3a0 => generated 1734 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:41:55.884126 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-108c965d-d90f-45d0-ad04-46c47de6883b tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:41:55.884675 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-108c965d-d90f-45d0-ad04-46c47de6883b tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] [instance: f49079c1-1384-4136-b6cf-eadc40fb5aa1] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:41:55.891044 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-108c965d-d90f-45d0-ad04-46c47de6883b tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:41:55.891488 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-108c965d-d90f-45d0-ad04-46c47de6883b tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:41:55.892524 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-108c965d-d90f-45d0-ad04-46c47de6883b tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:41:55.892956 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-108c965d-d90f-45d0-ad04-46c47de6883b tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:41:56.023442 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-108c965d-d90f-45d0-ad04-46c47de6883b tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b7d82c999646b6b6b96d565f0e3f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe30c756a2f84166ad23af1edf83157e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:41:56.030744 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-108c965d-d90f-45d0-ad04-46c47de6883b tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] 10.222.0.42 "GET /compute/v2.1/servers/f49079c1-1384-4136-b6cf-eadc40fb5aa1" status: 200 len: 1662 microversion: 2.1 time: 0.150703 Jun 06 10:41:56.031294 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 223/463] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:41:55 2022] GET /compute/v2.1/servers/f49079c1-1384-4136-b6cf-eadc40fb5aa1 => generated 1662 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:41:56.434353 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-06d8be17-58ae-42a7-9772-1d512138b351 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:41:56.435054 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-06d8be17-58ae-42a7-9772-1d512138b351 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] [instance: d4d7ae82-4a52-4e0e-87b5-13a5b95cc3a0] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:41:56.442662 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-06d8be17-58ae-42a7-9772-1d512138b351 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:41:56.443324 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-06d8be17-58ae-42a7-9772-1d512138b351 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:41:56.444557 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-06d8be17-58ae-42a7-9772-1d512138b351 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:41:56.445190 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-06d8be17-58ae-42a7-9772-1d512138b351 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:41:56.575433 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-06d8be17-58ae-42a7-9772-1d512138b351 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f269e146c844480c822347c3a38d103b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2b17b61b73b4e6d81dd8ffe9cf311ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:41:56.583255 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-06d8be17-58ae-42a7-9772-1d512138b351 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] 10.222.0.42 "GET /compute/v2.1/servers/d4d7ae82-4a52-4e0e-87b5-13a5b95cc3a0" status: 200 len: 1734 microversion: 2.1 time: 0.152708 Jun 06 10:41:56.583830 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 241/464] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:41:56 2022] GET /compute/v2.1/servers/d4d7ae82-4a52-4e0e-87b5-13a5b95cc3a0 => generated 1734 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:41:57.047883 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-930b07f5-8e1c-4466-ab02-a093bfe9f687 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:41:57.048408 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-930b07f5-8e1c-4466-ab02-a093bfe9f687 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] [instance: f49079c1-1384-4136-b6cf-eadc40fb5aa1] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:41:57.055777 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-930b07f5-8e1c-4466-ab02-a093bfe9f687 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:41:57.056242 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-930b07f5-8e1c-4466-ab02-a093bfe9f687 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:41:57.056998 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-930b07f5-8e1c-4466-ab02-a093bfe9f687 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:41:57.057424 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-930b07f5-8e1c-4466-ab02-a093bfe9f687 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:41:57.186105 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-930b07f5-8e1c-4466-ab02-a093bfe9f687 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b7d82c999646b6b6b96d565f0e3f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe30c756a2f84166ad23af1edf83157e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:41:57.193721 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-930b07f5-8e1c-4466-ab02-a093bfe9f687 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] 10.222.0.42 "GET /compute/v2.1/servers/f49079c1-1384-4136-b6cf-eadc40fb5aa1" status: 200 len: 1666 microversion: 2.1 time: 0.149721 Jun 06 10:41:57.194279 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 224/465] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:41:57 2022] GET /compute/v2.1/servers/f49079c1-1384-4136-b6cf-eadc40fb5aa1 => generated 1666 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:41:57.600152 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-5895b5fc-af47-4854-a085-5563a52a6d9f tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:41:57.600754 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-5895b5fc-af47-4854-a085-5563a52a6d9f tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] [instance: d4d7ae82-4a52-4e0e-87b5-13a5b95cc3a0] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:41:57.607136 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-5895b5fc-af47-4854-a085-5563a52a6d9f tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:41:57.607572 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-5895b5fc-af47-4854-a085-5563a52a6d9f tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:41:57.608378 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-5895b5fc-af47-4854-a085-5563a52a6d9f tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:41:57.608807 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-5895b5fc-af47-4854-a085-5563a52a6d9f tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:41:57.742540 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-5895b5fc-af47-4854-a085-5563a52a6d9f tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f269e146c844480c822347c3a38d103b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2b17b61b73b4e6d81dd8ffe9cf311ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:41:57.750463 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-5895b5fc-af47-4854-a085-5563a52a6d9f tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] 10.222.0.42 "GET /compute/v2.1/servers/d4d7ae82-4a52-4e0e-87b5-13a5b95cc3a0" status: 200 len: 1734 microversion: 2.1 time: 0.154261 Jun 06 10:41:57.751032 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 242/466] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:41:57 2022] GET /compute/v2.1/servers/d4d7ae82-4a52-4e0e-87b5-13a5b95cc3a0 => generated 1734 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:41:58.769183 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-e5f391f3-1069-45fe-b5af-5fa3d78eca29 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:41:58.769715 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-e5f391f3-1069-45fe-b5af-5fa3d78eca29 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] [instance: d4d7ae82-4a52-4e0e-87b5-13a5b95cc3a0] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:41:58.776287 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-e5f391f3-1069-45fe-b5af-5fa3d78eca29 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:41:58.776732 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-e5f391f3-1069-45fe-b5af-5fa3d78eca29 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:41:58.777488 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-e5f391f3-1069-45fe-b5af-5fa3d78eca29 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:41:58.777942 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-e5f391f3-1069-45fe-b5af-5fa3d78eca29 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:41:58.903979 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-e5f391f3-1069-45fe-b5af-5fa3d78eca29 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f269e146c844480c822347c3a38d103b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2b17b61b73b4e6d81dd8ffe9cf311ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:41:58.912744 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-e5f391f3-1069-45fe-b5af-5fa3d78eca29 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] 10.222.0.42 "GET /compute/v2.1/servers/d4d7ae82-4a52-4e0e-87b5-13a5b95cc3a0" status: 200 len: 1734 microversion: 2.1 time: 0.148877 Jun 06 10:41:58.913302 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 225/467] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:41:58 2022] GET /compute/v2.1/servers/d4d7ae82-4a52-4e0e-87b5-13a5b95cc3a0 => generated 1734 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:41:59.929617 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-7bea9f72-091b-4759-b3ca-8e4ef02afa1c tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:41:59.930223 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-7bea9f72-091b-4759-b3ca-8e4ef02afa1c tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] [instance: d4d7ae82-4a52-4e0e-87b5-13a5b95cc3a0] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:41:59.936707 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-7bea9f72-091b-4759-b3ca-8e4ef02afa1c tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:41:59.937146 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-7bea9f72-091b-4759-b3ca-8e4ef02afa1c tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:41:59.937901 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-7bea9f72-091b-4759-b3ca-8e4ef02afa1c tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:41:59.938333 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-7bea9f72-091b-4759-b3ca-8e4ef02afa1c tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:42:00.069149 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-7bea9f72-091b-4759-b3ca-8e4ef02afa1c tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f269e146c844480c822347c3a38d103b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2b17b61b73b4e6d81dd8ffe9cf311ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:42:00.076933 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-7bea9f72-091b-4759-b3ca-8e4ef02afa1c tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] 10.222.0.42 "GET /compute/v2.1/servers/d4d7ae82-4a52-4e0e-87b5-13a5b95cc3a0" status: 200 len: 1734 microversion: 2.1 time: 0.151133 Jun 06 10:42:00.077484 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 243/468] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:41:59 2022] GET /compute/v2.1/servers/d4d7ae82-4a52-4e0e-87b5-13a5b95cc3a0 => generated 1734 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:42:01.094631 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-4d67ba93-b50d-4e86-9322-63e6f6655803 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:42:01.095216 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-4d67ba93-b50d-4e86-9322-63e6f6655803 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] [instance: d4d7ae82-4a52-4e0e-87b5-13a5b95cc3a0] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:42:01.102504 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-4d67ba93-b50d-4e86-9322-63e6f6655803 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:42:01.102952 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-4d67ba93-b50d-4e86-9322-63e6f6655803 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:42:01.103718 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-4d67ba93-b50d-4e86-9322-63e6f6655803 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:42:01.104182 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-4d67ba93-b50d-4e86-9322-63e6f6655803 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:42:01.231903 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-4d67ba93-b50d-4e86-9322-63e6f6655803 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f269e146c844480c822347c3a38d103b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2b17b61b73b4e6d81dd8ffe9cf311ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:42:01.240644 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-4d67ba93-b50d-4e86-9322-63e6f6655803 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] 10.222.0.42 "GET /compute/v2.1/servers/d4d7ae82-4a52-4e0e-87b5-13a5b95cc3a0" status: 200 len: 1734 microversion: 2.1 time: 0.149906 Jun 06 10:42:01.241499 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 226/469] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:42:01 2022] GET /compute/v2.1/servers/d4d7ae82-4a52-4e0e-87b5-13a5b95cc3a0 => generated 1734 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:42:01.795240 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-3380d246-708a-465b-bd63-bf5e4a53e907 tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:42:01.795960 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-3380d246-708a-465b-bd63-bf5e4a53e907 tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] [instance: 8e9cb9c1-7df9-4cb7-9121-54bf74f552c7] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:42:01.802831 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-3380d246-708a-465b-bd63-bf5e4a53e907 tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:42:01.803253 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-3380d246-708a-465b-bd63-bf5e4a53e907 tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:42:01.804027 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-3380d246-708a-465b-bd63-bf5e4a53e907 tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:42:01.804455 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-3380d246-708a-465b-bd63-bf5e4a53e907 tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:42:01.936733 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-3380d246-708a-465b-bd63-bf5e4a53e907 tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7b11ed004fc4ef3a1f1c48adf31fe8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '645eadf589944a24bf6e27326a61952c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:42:01.944592 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-3380d246-708a-465b-bd63-bf5e4a53e907 tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] 10.222.0.42 "GET /compute/v2.1/servers/8e9cb9c1-7df9-4cb7-9121-54bf74f552c7" status: 200 len: 1594 microversion: 2.1 time: 0.153708 Jun 06 10:42:01.945168 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 244/470] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:42:01 2022] GET /compute/v2.1/servers/8e9cb9c1-7df9-4cb7-9121-54bf74f552c7 => generated 1594 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:42:02.258677 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-0bdabacb-6df4-4d0f-ad14-df7f6a698ec2 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:42:02.259293 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-0bdabacb-6df4-4d0f-ad14-df7f6a698ec2 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] [instance: d4d7ae82-4a52-4e0e-87b5-13a5b95cc3a0] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:42:02.265894 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-0bdabacb-6df4-4d0f-ad14-df7f6a698ec2 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:42:02.266344 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-0bdabacb-6df4-4d0f-ad14-df7f6a698ec2 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:42:02.267108 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-0bdabacb-6df4-4d0f-ad14-df7f6a698ec2 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:42:02.267823 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-0bdabacb-6df4-4d0f-ad14-df7f6a698ec2 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:42:02.454224 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-0bdabacb-6df4-4d0f-ad14-df7f6a698ec2 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f269e146c844480c822347c3a38d103b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2b17b61b73b4e6d81dd8ffe9cf311ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:42:02.462351 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-0bdabacb-6df4-4d0f-ad14-df7f6a698ec2 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] 10.222.0.42 "GET /compute/v2.1/servers/d4d7ae82-4a52-4e0e-87b5-13a5b95cc3a0" status: 200 len: 1734 microversion: 2.1 time: 0.207505 Jun 06 10:42:02.462918 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 227/471] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:42:02 2022] GET /compute/v2.1/servers/d4d7ae82-4a52-4e0e-87b5-13a5b95cc3a0 => generated 1734 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:42:03.480393 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-d64fa29a-0adb-4fb6-95db-1b3bf01c8e51 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:42:03.481006 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-d64fa29a-0adb-4fb6-95db-1b3bf01c8e51 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] [instance: d4d7ae82-4a52-4e0e-87b5-13a5b95cc3a0] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:42:03.482977 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG dbcounter [-] [129349] Writing DB stats nova_cell0:SELECT=2 {{(pid=129349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 10:42:03.489132 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-d64fa29a-0adb-4fb6-95db-1b3bf01c8e51 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:42:03.489655 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-d64fa29a-0adb-4fb6-95db-1b3bf01c8e51 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:42:03.490440 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-d64fa29a-0adb-4fb6-95db-1b3bf01c8e51 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:42:03.490873 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-d64fa29a-0adb-4fb6-95db-1b3bf01c8e51 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:42:03.709319 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-d64fa29a-0adb-4fb6-95db-1b3bf01c8e51 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f269e146c844480c822347c3a38d103b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2b17b61b73b4e6d81dd8ffe9cf311ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:42:03.717930 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-d64fa29a-0adb-4fb6-95db-1b3bf01c8e51 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] 10.222.0.42 "GET /compute/v2.1/servers/d4d7ae82-4a52-4e0e-87b5-13a5b95cc3a0" status: 200 len: 1734 microversion: 2.1 time: 0.241325 Jun 06 10:42:03.728396 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [req-81937e88-9d23-4a41-b428-c482084bfbbd req-3ca59f0d-0f46-4bbf-97f9-90e9405b6aec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8e9cb9c1-7df9-4cb7-9121-54bf74f552c7", "tag": "d50634ea-b30b-4bd6-b547-ee82d39a4a57"}]} {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 10:42:03.731810 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 245/472] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:42:03 2022] GET /compute/v2.1/servers/d4d7ae82-4a52-4e0e-87b5-13a5b95cc3a0 => generated 1734 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:42:03.736747 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [req-81937e88-9d23-4a41-b428-c482084bfbbd req-3ca59f0d-0f46-4bbf-97f9-90e9405b6aec service nova] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:42:03.737457 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [req-81937e88-9d23-4a41-b428-c482084bfbbd req-3ca59f0d-0f46-4bbf-97f9-90e9405b6aec service nova] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:42:03.748934 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.compute.server_external_events [req-81937e88-9d23-4a41-b428-c482084bfbbd req-3ca59f0d-0f46-4bbf-97f9-90e9405b6aec service nova] Creating event network-changed:d50634ea-b30b-4bd6-b547-ee82d39a4a57 for instance 8e9cb9c1-7df9-4cb7-9121-54bf74f552c7 on hv-cinder-84482 Jun 06 10:42:03.755107 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [req-81937e88-9d23-4a41-b428-c482084bfbbd req-3ca59f0d-0f46-4bbf-97f9-90e9405b6aec service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030170 Jun 06 10:42:03.755981 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 228/473] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Jun 6 10:42:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 10:42:04.730125 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-cdbacc45-bddc-4d36-aa6a-525599c73c78 tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-165633087"}} {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 10:42:04.730786 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-cdbacc45-bddc-4d36-aa6a-525599c73c78 tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] [instance: 8e9cb9c1-7df9-4cb7-9121-54bf74f552c7] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:42:04.739002 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-cdbacc45-bddc-4d36-aa6a-525599c73c78 tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:42:04.740014 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-cdbacc45-bddc-4d36-aa6a-525599c73c78 tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:42:04.740279 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-c1842928-1560-4005-bc3d-ddc45e954a9f tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:42:04.741010 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-c1842928-1560-4005-bc3d-ddc45e954a9f tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] [instance: d4d7ae82-4a52-4e0e-87b5-13a5b95cc3a0] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:42:04.741199 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-cdbacc45-bddc-4d36-aa6a-525599c73c78 tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:42:04.742005 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-cdbacc45-bddc-4d36-aa6a-525599c73c78 tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:42:04.747228 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-c1842928-1560-4005-bc3d-ddc45e954a9f tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:42:04.747675 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-c1842928-1560-4005-bc3d-ddc45e954a9f tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:42:04.748501 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-c1842928-1560-4005-bc3d-ddc45e954a9f tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:42:04.748923 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-c1842928-1560-4005-bc3d-ddc45e954a9f tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:42:04.952207 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.network.security_group_api [None req-cdbacc45-bddc-4d36-aa6a-525599c73c78 tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Adding security group 230a3572-5b10-48b9-ab14-7b3832584c01 to port d50634ea-b30b-4bd6-b547-ee82d39a4a57 Jun 06 10:42:04.957611 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-c1842928-1560-4005-bc3d-ddc45e954a9f tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f269e146c844480c822347c3a38d103b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2b17b61b73b4e6d81dd8ffe9cf311ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:42:04.959963 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG dbcounter [-] [129350] Writing DB stats nova_cell1:SELECT=100 {{(pid=129350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 10:42:04.967190 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-c1842928-1560-4005-bc3d-ddc45e954a9f tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] 10.222.0.42 "GET /compute/v2.1/servers/d4d7ae82-4a52-4e0e-87b5-13a5b95cc3a0" status: 200 len: 1734 microversion: 2.1 time: 0.232512 Jun 06 10:42:04.967980 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 229/474] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:42:04 2022] GET /compute/v2.1/servers/d4d7ae82-4a52-4e0e-87b5-13a5b95cc3a0 => generated 1734 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 10:42:05.773600 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-cdbacc45-bddc-4d36-aa6a-525599c73c78 tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] 10.222.0.42 "POST /compute/v2.1/servers/8e9cb9c1-7df9-4cb7-9121-54bf74f552c7/action" status: 202 len: 0 microversion: 2.1 time: 1.046971 Jun 06 10:42:05.777572 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 246/475] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Jun 6 10:42:04 2022] POST /compute/v2.1/servers/8e9cb9c1-7df9-4cb7-9121-54bf74f552c7/action => generated 0 bytes in 1052 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 06 10:42:05.782506 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-f0b23ecc-354a-47a8-802e-7e95bf8c60e6 tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:42:05.783119 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-f0b23ecc-354a-47a8-802e-7e95bf8c60e6 tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] [instance: 8e9cb9c1-7df9-4cb7-9121-54bf74f552c7] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:42:05.785883 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [req-05cd8c3e-d0ef-400f-99d1-41779545c5d8 req-95f55c4f-5f0b-4ec8-bbf9-d54c8d7eb6b6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8e9cb9c1-7df9-4cb7-9121-54bf74f552c7", "tag": "d50634ea-b30b-4bd6-b547-ee82d39a4a57"}]} {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 10:42:05.794983 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG dbcounter [-] [129349] Writing DB stats nova_api:SELECT=68 {{(pid=129349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 10:42:05.796107 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-f0b23ecc-354a-47a8-802e-7e95bf8c60e6 tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:42:05.796814 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-f0b23ecc-354a-47a8-802e-7e95bf8c60e6 tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:42:05.798966 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [req-05cd8c3e-d0ef-400f-99d1-41779545c5d8 req-95f55c4f-5f0b-4ec8-bbf9-d54c8d7eb6b6 service nova] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:42:05.799717 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [req-05cd8c3e-d0ef-400f-99d1-41779545c5d8 req-95f55c4f-5f0b-4ec8-bbf9-d54c8d7eb6b6 service nova] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:42:05.802290 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-f0b23ecc-354a-47a8-802e-7e95bf8c60e6 tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:42:05.802762 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-f0b23ecc-354a-47a8-802e-7e95bf8c60e6 tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:42:05.833373 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.compute.server_external_events [req-05cd8c3e-d0ef-400f-99d1-41779545c5d8 req-95f55c4f-5f0b-4ec8-bbf9-d54c8d7eb6b6 service nova] Creating event network-changed:d50634ea-b30b-4bd6-b547-ee82d39a4a57 for instance 8e9cb9c1-7df9-4cb7-9121-54bf74f552c7 on hv-cinder-84482 Jun 06 10:42:05.842768 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [req-05cd8c3e-d0ef-400f-99d1-41779545c5d8 req-95f55c4f-5f0b-4ec8-bbf9-d54c8d7eb6b6 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062370 Jun 06 10:42:05.843474 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 247/476] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Jun 6 10:42:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 10:42:05.993951 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-df66e9dd-b25e-4e3d-b183-a28d0a7a92cb tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:42:05.994819 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-df66e9dd-b25e-4e3d-b183-a28d0a7a92cb tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] [instance: d4d7ae82-4a52-4e0e-87b5-13a5b95cc3a0] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:42:06.001451 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-df66e9dd-b25e-4e3d-b183-a28d0a7a92cb tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:42:06.001908 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-df66e9dd-b25e-4e3d-b183-a28d0a7a92cb tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:42:06.003006 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-df66e9dd-b25e-4e3d-b183-a28d0a7a92cb tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:42:06.003587 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-df66e9dd-b25e-4e3d-b183-a28d0a7a92cb tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:42:06.302352 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-f0b23ecc-354a-47a8-802e-7e95bf8c60e6 tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7b11ed004fc4ef3a1f1c48adf31fe8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '645eadf589944a24bf6e27326a61952c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:42:06.313415 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-f0b23ecc-354a-47a8-802e-7e95bf8c60e6 tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] 10.222.0.42 "GET /compute/v2.1/servers/8e9cb9c1-7df9-4cb7-9121-54bf74f552c7" status: 200 len: 1759 microversion: 2.1 time: 0.534878 Jun 06 10:42:06.314383 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 230/477] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:42:05 2022] GET /compute/v2.1/servers/8e9cb9c1-7df9-4cb7-9121-54bf74f552c7 => generated 1759 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 10:42:06.433035 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-df66e9dd-b25e-4e3d-b183-a28d0a7a92cb tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f269e146c844480c822347c3a38d103b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2b17b61b73b4e6d81dd8ffe9cf311ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:42:06.446017 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-df66e9dd-b25e-4e3d-b183-a28d0a7a92cb tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] 10.222.0.42 "GET /compute/v2.1/servers/d4d7ae82-4a52-4e0e-87b5-13a5b95cc3a0" status: 200 len: 1734 microversion: 2.1 time: 0.464490 Jun 06 10:42:06.446823 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 248/478] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:42:05 2022] GET /compute/v2.1/servers/d4d7ae82-4a52-4e0e-87b5-13a5b95cc3a0 => generated 1734 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 10:42:07.463334 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-992efdca-18ca-4132-9863-9a92efcc68f8 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:42:07.463988 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-992efdca-18ca-4132-9863-9a92efcc68f8 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] [instance: d4d7ae82-4a52-4e0e-87b5-13a5b95cc3a0] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:42:07.466258 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG dbcounter [-] [129350] Writing DB stats nova_api:SELECT=74 {{(pid=129350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 10:42:07.471796 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-992efdca-18ca-4132-9863-9a92efcc68f8 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:42:07.472245 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-992efdca-18ca-4132-9863-9a92efcc68f8 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:42:07.473006 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-992efdca-18ca-4132-9863-9a92efcc68f8 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:42:07.473437 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-992efdca-18ca-4132-9863-9a92efcc68f8 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:42:07.602924 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-992efdca-18ca-4132-9863-9a92efcc68f8 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f269e146c844480c822347c3a38d103b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2b17b61b73b4e6d81dd8ffe9cf311ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:42:07.610730 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-992efdca-18ca-4132-9863-9a92efcc68f8 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] 10.222.0.42 "GET /compute/v2.1/servers/d4d7ae82-4a52-4e0e-87b5-13a5b95cc3a0" status: 200 len: 1734 microversion: 2.1 time: 0.151216 Jun 06 10:42:07.611304 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 231/479] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:42:07 2022] GET /compute/v2.1/servers/d4d7ae82-4a52-4e0e-87b5-13a5b95cc3a0 => generated 1734 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:42:08.628175 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-48e51a12-04f7-4591-a3cc-0acafa0e641c tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:42:08.628788 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-48e51a12-04f7-4591-a3cc-0acafa0e641c tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] [instance: d4d7ae82-4a52-4e0e-87b5-13a5b95cc3a0] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:42:08.635282 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-48e51a12-04f7-4591-a3cc-0acafa0e641c tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:42:08.635677 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-48e51a12-04f7-4591-a3cc-0acafa0e641c tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:42:08.636486 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-48e51a12-04f7-4591-a3cc-0acafa0e641c tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:42:08.636928 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-48e51a12-04f7-4591-a3cc-0acafa0e641c tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:42:08.782847 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-48e51a12-04f7-4591-a3cc-0acafa0e641c tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f269e146c844480c822347c3a38d103b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2b17b61b73b4e6d81dd8ffe9cf311ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:42:08.799643 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-48e51a12-04f7-4591-a3cc-0acafa0e641c tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] 10.222.0.42 "GET /compute/v2.1/servers/d4d7ae82-4a52-4e0e-87b5-13a5b95cc3a0" status: 200 len: 1734 microversion: 2.1 time: 0.174981 Jun 06 10:42:08.800393 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 249/480] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:42:08 2022] GET /compute/v2.1/servers/d4d7ae82-4a52-4e0e-87b5-13a5b95cc3a0 => generated 1734 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:42:09.817021 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-b940ab4b-79b3-42b2-8ca5-4049c206ff17 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:42:09.817632 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-b940ab4b-79b3-42b2-8ca5-4049c206ff17 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] [instance: d4d7ae82-4a52-4e0e-87b5-13a5b95cc3a0] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:42:09.824138 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-b940ab4b-79b3-42b2-8ca5-4049c206ff17 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:42:09.824582 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-b940ab4b-79b3-42b2-8ca5-4049c206ff17 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:42:09.825340 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-b940ab4b-79b3-42b2-8ca5-4049c206ff17 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:42:09.825771 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-b940ab4b-79b3-42b2-8ca5-4049c206ff17 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:42:09.957608 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-b940ab4b-79b3-42b2-8ca5-4049c206ff17 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f269e146c844480c822347c3a38d103b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2b17b61b73b4e6d81dd8ffe9cf311ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:42:09.965526 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-b940ab4b-79b3-42b2-8ca5-4049c206ff17 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] 10.222.0.42 "GET /compute/v2.1/servers/d4d7ae82-4a52-4e0e-87b5-13a5b95cc3a0" status: 200 len: 1734 microversion: 2.1 time: 0.152291 Jun 06 10:42:09.966092 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 232/481] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:42:09 2022] GET /compute/v2.1/servers/d4d7ae82-4a52-4e0e-87b5-13a5b95cc3a0 => generated 1734 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:42:10.982399 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-f0702667-5746-48fa-813c-838c967d0a79 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:42:10.983001 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-f0702667-5746-48fa-813c-838c967d0a79 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] [instance: d4d7ae82-4a52-4e0e-87b5-13a5b95cc3a0] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:42:10.989997 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-f0702667-5746-48fa-813c-838c967d0a79 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:42:10.990435 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-f0702667-5746-48fa-813c-838c967d0a79 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:42:10.991188 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-f0702667-5746-48fa-813c-838c967d0a79 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:42:10.991616 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-f0702667-5746-48fa-813c-838c967d0a79 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:42:11.120564 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-f0702667-5746-48fa-813c-838c967d0a79 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f269e146c844480c822347c3a38d103b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2b17b61b73b4e6d81dd8ffe9cf311ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:42:11.129115 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-f0702667-5746-48fa-813c-838c967d0a79 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] 10.222.0.42 "GET /compute/v2.1/servers/d4d7ae82-4a52-4e0e-87b5-13a5b95cc3a0" status: 200 len: 1734 microversion: 2.1 time: 0.150566 Jun 06 10:42:11.129680 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 250/482] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:42:10 2022] GET /compute/v2.1/servers/d4d7ae82-4a52-4e0e-87b5-13a5b95cc3a0 => generated 1734 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:42:12.147139 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-c280017b-061b-44b6-9844-9bb1ee2a1812 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:42:12.147745 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-c280017b-061b-44b6-9844-9bb1ee2a1812 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] [instance: d4d7ae82-4a52-4e0e-87b5-13a5b95cc3a0] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:42:12.154272 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-c280017b-061b-44b6-9844-9bb1ee2a1812 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:42:12.154715 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-c280017b-061b-44b6-9844-9bb1ee2a1812 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:42:12.155471 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-c280017b-061b-44b6-9844-9bb1ee2a1812 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:42:12.155934 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-c280017b-061b-44b6-9844-9bb1ee2a1812 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:42:12.282826 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-c280017b-061b-44b6-9844-9bb1ee2a1812 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f269e146c844480c822347c3a38d103b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2b17b61b73b4e6d81dd8ffe9cf311ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:42:12.290777 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-c280017b-061b-44b6-9844-9bb1ee2a1812 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] 10.222.0.42 "GET /compute/v2.1/servers/d4d7ae82-4a52-4e0e-87b5-13a5b95cc3a0" status: 200 len: 1734 microversion: 2.1 time: 0.148074 Jun 06 10:42:12.291339 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 233/483] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:42:12 2022] GET /compute/v2.1/servers/d4d7ae82-4a52-4e0e-87b5-13a5b95cc3a0 => generated 1734 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:42:13.309213 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-ed6b4ea2-6f29-4653-84ef-61b52c614a73 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:42:13.309826 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-ed6b4ea2-6f29-4653-84ef-61b52c614a73 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] [instance: d4d7ae82-4a52-4e0e-87b5-13a5b95cc3a0] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:42:13.316363 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-ed6b4ea2-6f29-4653-84ef-61b52c614a73 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:42:13.316810 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-ed6b4ea2-6f29-4653-84ef-61b52c614a73 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:42:13.317570 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-ed6b4ea2-6f29-4653-84ef-61b52c614a73 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:42:13.318001 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-ed6b4ea2-6f29-4653-84ef-61b52c614a73 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:42:13.451959 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-ed6b4ea2-6f29-4653-84ef-61b52c614a73 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f269e146c844480c822347c3a38d103b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2b17b61b73b4e6d81dd8ffe9cf311ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:42:13.461526 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-ed6b4ea2-6f29-4653-84ef-61b52c614a73 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] 10.222.0.42 "GET /compute/v2.1/servers/d4d7ae82-4a52-4e0e-87b5-13a5b95cc3a0" status: 200 len: 1734 microversion: 2.1 time: 0.156030 Jun 06 10:42:13.462115 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 251/484] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:42:13 2022] GET /compute/v2.1/servers/d4d7ae82-4a52-4e0e-87b5-13a5b95cc3a0 => generated 1734 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:42:14.478787 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-625be3cb-7606-44b4-b056-ebaf46f0bd65 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:42:14.479395 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-625be3cb-7606-44b4-b056-ebaf46f0bd65 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] [instance: d4d7ae82-4a52-4e0e-87b5-13a5b95cc3a0] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:42:14.485289 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-625be3cb-7606-44b4-b056-ebaf46f0bd65 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:42:14.485727 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-625be3cb-7606-44b4-b056-ebaf46f0bd65 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:42:14.486550 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-625be3cb-7606-44b4-b056-ebaf46f0bd65 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:42:14.487133 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-625be3cb-7606-44b4-b056-ebaf46f0bd65 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:42:14.612680 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-625be3cb-7606-44b4-b056-ebaf46f0bd65 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f269e146c844480c822347c3a38d103b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2b17b61b73b4e6d81dd8ffe9cf311ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:42:14.620556 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-625be3cb-7606-44b4-b056-ebaf46f0bd65 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] 10.222.0.42 "GET /compute/v2.1/servers/d4d7ae82-4a52-4e0e-87b5-13a5b95cc3a0" status: 200 len: 1714 microversion: 2.1 time: 0.145731 Jun 06 10:42:14.621101 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 234/485] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:42:14 2022] GET /compute/v2.1/servers/d4d7ae82-4a52-4e0e-87b5-13a5b95cc3a0 => generated 1714 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:42:14.728408 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-d456e87b-e0ce-431c-9c49-4e0771b0457a tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:42:14.728922 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-d456e87b-e0ce-431c-9c49-4e0771b0457a tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] [instance: d4d7ae82-4a52-4e0e-87b5-13a5b95cc3a0] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:42:14.735340 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-d456e87b-e0ce-431c-9c49-4e0771b0457a tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:42:14.735790 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-d456e87b-e0ce-431c-9c49-4e0771b0457a tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:42:14.737403 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-d456e87b-e0ce-431c-9c49-4e0771b0457a tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:42:14.737593 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-d456e87b-e0ce-431c-9c49-4e0771b0457a tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:42:14.857312 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.wsgi [None req-d456e87b-e0ce-431c-9c49-4e0771b0457a tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] HTTP exception thrown: Cannot 'detach_volume' instance d4d7ae82-4a52-4e0e-87b5-13a5b95cc3a0 while it is in vm_state rescued Jun 06 10:42:14.858893 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-d456e87b-e0ce-431c-9c49-4e0771b0457a tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Request method failure captured: Jun 06 10:42:14.858893 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: request: DELETE /compute/v2.1/servers/d4d7ae82-4a52-4e0e-87b5-13a5b95cc3a0/os-volume_attachments/a552af91-4f0b-475b-bfbb-1078f971dd78 HTTP/1.1 Jun 06 10:42:14.858893 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: Accept: application/json Jun 06 10:42:14.858893 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: Accept-Encoding: identity Jun 06 10:42:14.858893 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: Connection: close Jun 06 10:42:14.858893 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: Content-Length: 0 Jun 06 10:42:14.858893 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: Content-Type: application/json Jun 06 10:42:14.858893 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: Host: 10.222.0.42 Jun 06 10:42:14.858893 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: Openstack-System-Scope: None Jun 06 10:42:14.858893 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: User-Agent: python-urllib3/1.26.9 Jun 06 10:42:14.858893 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Auth-Token: gAAAAABindkdTi5hfwDU83R9VhMkvWDNoCDXiLpe7k4NfzgQuE9NKNHlwwxS39qNqJOxZC6I04U-PKIxWUtLJRI9QDIkTy_6J-jWfq_sDX7gjSO5-TBVY66fu2QztBfvxrVdG6V04r923VMuTI7eBl9-Tc1Ek2lWzslMW2bMYBl_aa_BZDF8fUA Jun 06 10:42:14.858893 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Domain-Id: None Jun 06 10:42:14.858893 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Domain-Name: None Jun 06 10:42:14.858893 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Identity-Status: Confirmed Jun 06 10:42:14.858893 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Is-Admin-Project: True Jun 06 10:42:14.858893 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Project-Domain-Id: default Jun 06 10:42:14.858893 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Project-Domain-Name: Default Jun 06 10:42:14.858893 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Project-Id: e2b17b61b73b4e6d81dd8ffe9cf311ea Jun 06 10:42:14.858893 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-845602198 Jun 06 10:42:14.858893 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Role: member,reader Jun 06 10:42:14.858893 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Roles: member,reader Jun 06 10:42:14.860604 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/e2b17b61b73b4e6d81dd8ffe9cf311ea"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e2b17b61b73b4e6d81dd8ffe9cf311ea"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e2b17b61b73b4e6d81dd8ffe9cf311ea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_e2b17b61b73b4e6d81dd8ffe9cf311ea", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Jun 06 10:42:14.860604 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Tenant: tempest-ServerRescueNegativeTestJSON-845602198 Jun 06 10:42:14.860604 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Tenant-Id: e2b17b61b73b4e6d81dd8ffe9cf311ea Jun 06 10:42:14.860604 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-845602198 Jun 06 10:42:14.860604 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-User: tempest-ServerRescueNegativeTestJSON-845602198-project Jun 06 10:42:14.860604 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-User-Domain-Id: default Jun 06 10:42:14.860604 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-User-Domain-Name: Default Jun 06 10:42:14.860604 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-User-Id: f269e146c844480c822347c3a38d103b Jun 06 10:42:14.860604 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-User-Name: tempest-ServerRescueNegativeTestJSON-845602198-project Jun 06 10:42:14.860604 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: method: > Jun 06 10:42:14.860604 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: exception: Cannot 'detach_volume' instance d4d7ae82-4a52-4e0e-87b5-13a5b95cc3a0 while it is in vm_state rescued Jun 06 10:42:14.862064 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: action_args: {'server_id': 'd4d7ae82-4a52-4e0e-87b5-13a5b95cc3a0', 'id': 'a552af91-4f0b-475b-bfbb-1078f971dd78'} Jun 06 10:42:14.862064 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 10:42:14.862064 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 10:42:14.862064 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jun 06 10:42:14.862064 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jun 06 10:42:14.862064 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 06 10:42:14.862064 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 06 10:42:14.862064 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 06 10:42:14.862064 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 06 10:42:14.862064 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance d4d7ae82-4a52-4e0e-87b5-13a5b95cc3a0 in vm_state rescued. Cannot detach_volume while the instance is in this state. Jun 06 10:42:14.862064 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Jun 06 10:42:14.862064 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 10:42:14.862064 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Jun 06 10:42:14.862064 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 10:42:14.862064 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 10:42:14.862064 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 10:42:14.862064 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 10:42:14.862064 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 10:42:14.862064 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 10:42:14.862064 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 10:42:14.863644 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jun 06 10:42:14.863644 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 06 10:42:14.863644 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 06 10:42:14.863644 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 06 10:42:14.863644 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance d4d7ae82-4a52-4e0e-87b5-13a5b95cc3a0 while it is in vm_state rescued Jun 06 10:42:14.863644 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Jun 06 10:42:14.863644 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 10:42:14.863644 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Jun 06 10:42:14.863644 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 10:42:14.863644 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 10:42:14.863644 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 10:42:14.863644 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 10:42:14.863644 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 10:42:14.863644 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance d4d7ae82-4a52-4e0e-87b5-13a5b95cc3a0 while it is in vm_state rescued Jun 06 10:42:14.863644 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Jun 06 10:42:14.863644 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-d456e87b-e0ce-431c-9c49-4e0771b0457a tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Returning 409 to user: Cannot 'detach_volume' instance d4d7ae82-4a52-4e0e-87b5-13a5b95cc3a0 while it is in vm_state rescued {{(pid=129349) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 10:42:14.865274 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-d456e87b-e0ce-431c-9c49-4e0771b0457a tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] 10.222.0.42 "DELETE /compute/v2.1/servers/d4d7ae82-4a52-4e0e-87b5-13a5b95cc3a0/os-volume_attachments/a552af91-4f0b-475b-bfbb-1078f971dd78" status: 409 len: 152 microversion: 2.1 time: 0.135929 Jun 06 10:42:14.865274 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 252/486] 10.222.0.42 () {58 vars in 1415 bytes} [Mon Jun 6 10:42:14 2022] DELETE /compute/v2.1/servers/d4d7ae82-4a52-4e0e-87b5-13a5b95cc3a0/os-volume_attachments/a552af91-4f0b-475b-bfbb-1078f971dd78 => generated 152 bytes in 137 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 06 10:42:14.870208 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-e4858748-47c4-4f27-a849-3fccdf6b5e02 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 10:42:14.870732 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-e4858748-47c4-4f27-a849-3fccdf6b5e02 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] [instance: d4d7ae82-4a52-4e0e-87b5-13a5b95cc3a0] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:42:14.876669 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-e4858748-47c4-4f27-a849-3fccdf6b5e02 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:42:14.877837 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-e4858748-47c4-4f27-a849-3fccdf6b5e02 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:42:14.878784 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-e4858748-47c4-4f27-a849-3fccdf6b5e02 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:42:14.879216 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-e4858748-47c4-4f27-a849-3fccdf6b5e02 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:42:14.943709 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-e4858748-47c4-4f27-a849-3fccdf6b5e02 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] 10.222.0.42 "POST /compute/v2.1/servers/d4d7ae82-4a52-4e0e-87b5-13a5b95cc3a0/action" status: 202 len: 0 microversion: 2.1 time: 0.077204 Jun 06 10:42:14.944361 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 235/487] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Jun 6 10:42:14 2022] POST /compute/v2.1/servers/d4d7ae82-4a52-4e0e-87b5-13a5b95cc3a0/action => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 06 10:42:14.952619 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-92b2e55b-0005-4810-b1e3-b8274269a648 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:42:14.953260 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-92b2e55b-0005-4810-b1e3-b8274269a648 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] [instance: d4d7ae82-4a52-4e0e-87b5-13a5b95cc3a0] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:42:14.960390 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-92b2e55b-0005-4810-b1e3-b8274269a648 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:42:14.960883 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-92b2e55b-0005-4810-b1e3-b8274269a648 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:42:14.961596 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-92b2e55b-0005-4810-b1e3-b8274269a648 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:42:14.962025 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-92b2e55b-0005-4810-b1e3-b8274269a648 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:42:15.180115 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-92b2e55b-0005-4810-b1e3-b8274269a648 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f269e146c844480c822347c3a38d103b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2b17b61b73b4e6d81dd8ffe9cf311ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:42:15.183952 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG dbcounter [-] [129349] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=129349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 10:42:15.190401 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-92b2e55b-0005-4810-b1e3-b8274269a648 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] 10.222.0.42 "GET /compute/v2.1/servers/d4d7ae82-4a52-4e0e-87b5-13a5b95cc3a0" status: 200 len: 1722 microversion: 2.1 time: 0.241033 Jun 06 10:42:15.190975 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 253/488] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:42:14 2022] GET /compute/v2.1/servers/d4d7ae82-4a52-4e0e-87b5-13a5b95cc3a0 => generated 1722 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:42:16.209158 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-57cf234d-7319-4b49-bcf9-593422acbbf2 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:42:16.209850 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-57cf234d-7319-4b49-bcf9-593422acbbf2 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] [instance: d4d7ae82-4a52-4e0e-87b5-13a5b95cc3a0] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:42:16.216040 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-57cf234d-7319-4b49-bcf9-593422acbbf2 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:42:16.216481 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-57cf234d-7319-4b49-bcf9-593422acbbf2 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:42:16.217230 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-57cf234d-7319-4b49-bcf9-593422acbbf2 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:42:16.217658 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-57cf234d-7319-4b49-bcf9-593422acbbf2 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:42:16.350376 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-57cf234d-7319-4b49-bcf9-593422acbbf2 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f269e146c844480c822347c3a38d103b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2b17b61b73b4e6d81dd8ffe9cf311ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:42:16.358270 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-57cf234d-7319-4b49-bcf9-593422acbbf2 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] 10.222.0.42 "GET /compute/v2.1/servers/d4d7ae82-4a52-4e0e-87b5-13a5b95cc3a0" status: 200 len: 1722 microversion: 2.1 time: 0.153943 Jun 06 10:42:16.358821 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 236/489] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:42:16 2022] GET /compute/v2.1/servers/d4d7ae82-4a52-4e0e-87b5-13a5b95cc3a0 => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:42:17.376531 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-e19cd0cf-659a-45da-bc84-bb8b48d7d291 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:42:17.377248 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-e19cd0cf-659a-45da-bc84-bb8b48d7d291 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] [instance: d4d7ae82-4a52-4e0e-87b5-13a5b95cc3a0] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:42:17.385423 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-e19cd0cf-659a-45da-bc84-bb8b48d7d291 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:42:17.385869 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-e19cd0cf-659a-45da-bc84-bb8b48d7d291 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:42:17.386716 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-e19cd0cf-659a-45da-bc84-bb8b48d7d291 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:42:17.387176 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-e19cd0cf-659a-45da-bc84-bb8b48d7d291 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:42:17.527645 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-e19cd0cf-659a-45da-bc84-bb8b48d7d291 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f269e146c844480c822347c3a38d103b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2b17b61b73b4e6d81dd8ffe9cf311ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:42:17.536789 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-e19cd0cf-659a-45da-bc84-bb8b48d7d291 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] 10.222.0.42 "GET /compute/v2.1/servers/d4d7ae82-4a52-4e0e-87b5-13a5b95cc3a0" status: 200 len: 1722 microversion: 2.1 time: 0.164102 Jun 06 10:42:17.537362 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 254/490] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:42:17 2022] GET /compute/v2.1/servers/d4d7ae82-4a52-4e0e-87b5-13a5b95cc3a0 => generated 1722 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:42:18.557118 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-49f31515-2daa-481b-a70a-33300e53c47c tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:42:18.557722 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-49f31515-2daa-481b-a70a-33300e53c47c tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] [instance: d4d7ae82-4a52-4e0e-87b5-13a5b95cc3a0] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:42:18.565635 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-49f31515-2daa-481b-a70a-33300e53c47c tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:42:18.566081 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-49f31515-2daa-481b-a70a-33300e53c47c tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:42:18.566839 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-49f31515-2daa-481b-a70a-33300e53c47c tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:42:18.567266 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-49f31515-2daa-481b-a70a-33300e53c47c tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:42:18.702985 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-49f31515-2daa-481b-a70a-33300e53c47c tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f269e146c844480c822347c3a38d103b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2b17b61b73b4e6d81dd8ffe9cf311ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:42:18.711175 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-49f31515-2daa-481b-a70a-33300e53c47c tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] 10.222.0.42 "GET /compute/v2.1/servers/d4d7ae82-4a52-4e0e-87b5-13a5b95cc3a0" status: 200 len: 1728 microversion: 2.1 time: 0.157856 Jun 06 10:42:18.711739 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 237/491] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:42:18 2022] GET /compute/v2.1/servers/d4d7ae82-4a52-4e0e-87b5-13a5b95cc3a0 => generated 1728 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:42:18.728208 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-08156f4f-29ec-4537-a2a9-d6aaecb4bb15 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:42:18.728749 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-08156f4f-29ec-4537-a2a9-d6aaecb4bb15 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] [instance: d4d7ae82-4a52-4e0e-87b5-13a5b95cc3a0] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:42:18.735185 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-08156f4f-29ec-4537-a2a9-d6aaecb4bb15 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:42:18.735634 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-08156f4f-29ec-4537-a2a9-d6aaecb4bb15 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:42:18.737061 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-08156f4f-29ec-4537-a2a9-d6aaecb4bb15 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:42:18.737495 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-08156f4f-29ec-4537-a2a9-d6aaecb4bb15 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:42:18.821965 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-08156f4f-29ec-4537-a2a9-d6aaecb4bb15 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] 10.222.0.42 "GET /compute/v2.1/servers/d4d7ae82-4a52-4e0e-87b5-13a5b95cc3a0/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.097501 Jun 06 10:42:18.822547 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 255/492] 10.222.0.42 () {58 vars in 1274 bytes} [Mon Jun 6 10:42:18 2022] GET /compute/v2.1/servers/d4d7ae82-4a52-4e0e-87b5-13a5b95cc3a0/os-interface => generated 284 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 10:42:19.914967 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [req-a0fc08e3-c13b-4d1d-966c-2b90b0d7825f req-696cea2a-7be8-4e51-aaa4-0144f403de5d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d4d7ae82-4a52-4e0e-87b5-13a5b95cc3a0", "tag": "c4ec0cb9-f04f-437e-bf0f-93e81d012b38"}]} {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 10:42:19.925136 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [req-a0fc08e3-c13b-4d1d-966c-2b90b0d7825f req-696cea2a-7be8-4e51-aaa4-0144f403de5d service nova] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:42:19.926468 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [req-a0fc08e3-c13b-4d1d-966c-2b90b0d7825f req-696cea2a-7be8-4e51-aaa4-0144f403de5d service nova] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:42:19.939112 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.compute.server_external_events [req-a0fc08e3-c13b-4d1d-966c-2b90b0d7825f req-696cea2a-7be8-4e51-aaa4-0144f403de5d service nova] Creating event network-changed:c4ec0cb9-f04f-437e-bf0f-93e81d012b38 for instance d4d7ae82-4a52-4e0e-87b5-13a5b95cc3a0 on hv-cinder-84482 Jun 06 10:42:19.945195 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [req-a0fc08e3-c13b-4d1d-966c-2b90b0d7825f req-696cea2a-7be8-4e51-aaa4-0144f403de5d service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033850 Jun 06 10:42:19.945888 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 238/493] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Jun 6 10:42:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 10:42:21.960900 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [req-24599fc3-ec1b-4445-a891-35215c882d70 req-33b943fe-a9f4-4cf9-990b-6256fa491aca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d4d7ae82-4a52-4e0e-87b5-13a5b95cc3a0", "tag": "c4ec0cb9-f04f-437e-bf0f-93e81d012b38"}]} {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 10:42:21.968752 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [req-24599fc3-ec1b-4445-a891-35215c882d70 req-33b943fe-a9f4-4cf9-990b-6256fa491aca service nova] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:42:21.969185 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [req-24599fc3-ec1b-4445-a891-35215c882d70 req-33b943fe-a9f4-4cf9-990b-6256fa491aca service nova] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:42:21.979845 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.compute.server_external_events [req-24599fc3-ec1b-4445-a891-35215c882d70 req-33b943fe-a9f4-4cf9-990b-6256fa491aca service nova] Creating event network-changed:c4ec0cb9-f04f-437e-bf0f-93e81d012b38 for instance d4d7ae82-4a52-4e0e-87b5-13a5b95cc3a0 on hv-cinder-84482 Jun 06 10:42:21.984961 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [req-24599fc3-ec1b-4445-a891-35215c882d70 req-33b943fe-a9f4-4cf9-990b-6256fa491aca service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028147 Jun 06 10:42:21.985514 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 256/494] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Jun 6 10:42:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 10:42:28.852990 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-48e22638-d9eb-45e2-af0d-f5ac04bd6e2c tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:42:28.853567 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-48e22638-d9eb-45e2-af0d-f5ac04bd6e2c tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] [instance: 5a0a79a6-8e61-477e-8269-730dfb6d04a6] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:42:28.859651 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-48e22638-d9eb-45e2-af0d-f5ac04bd6e2c tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:42:28.860118 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-48e22638-d9eb-45e2-af0d-f5ac04bd6e2c tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:42:28.861068 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-48e22638-d9eb-45e2-af0d-f5ac04bd6e2c tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:42:28.861647 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-48e22638-d9eb-45e2-af0d-f5ac04bd6e2c tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:42:28.889352 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-48e22638-d9eb-45e2-af0d-f5ac04bd6e2c tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0a79a6-8e61-477e-8269-730dfb6d04a6/os-volume_attachments/44a4c5d1-1257-4bd7-aa88-491f396d04cb" status: 200 len: 194 microversion: 2.20 time: 0.041378 Jun 06 10:42:28.889920 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 239/495] 10.222.0.42 () {60 vars in 1453 bytes} [Mon Jun 6 10:42:28 2022] GET /compute/v2.1/servers/5a0a79a6-8e61-477e-8269-730dfb6d04a6/os-volume_attachments/44a4c5d1-1257-4bd7-aa88-491f396d04cb => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 06 10:42:28.950561 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-75937777-a3c8-4b39-9384-3912b740d36c tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:42:28.951145 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-75937777-a3c8-4b39-9384-3912b740d36c tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] [instance: 5a0a79a6-8e61-477e-8269-730dfb6d04a6] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:42:28.958510 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-75937777-a3c8-4b39-9384-3912b740d36c tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:42:28.958954 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-75937777-a3c8-4b39-9384-3912b740d36c tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:42:28.959709 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-75937777-a3c8-4b39-9384-3912b740d36c tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:42:28.960166 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-75937777-a3c8-4b39-9384-3912b740d36c tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:42:29.038746 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.objects.instance [None req-75937777-a3c8-4b39-9384-3912b740d36c tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lazy-loading 'services' on Instance uuid 5a0a79a6-8e61-477e-8269-730dfb6d04a6 {{(pid=129349) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 06 10:42:29.146122 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-75937777-a3c8-4b39-9384-3912b740d36c tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] 10.222.0.42 "DELETE /compute/v2.1/servers/5a0a79a6-8e61-477e-8269-730dfb6d04a6/os-volume_attachments/44a4c5d1-1257-4bd7-aa88-491f396d04cb" status: 202 len: 0 microversion: 2.20 time: 0.199610 Jun 06 10:42:29.146705 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 257/496] 10.222.0.42 () {60 vars in 1456 bytes} [Mon Jun 6 10:42:28 2022] DELETE /compute/v2.1/servers/5a0a79a6-8e61-477e-8269-730dfb6d04a6/os-volume_attachments/44a4c5d1-1257-4bd7-aa88-491f396d04cb => generated 0 bytes in 201 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 06 10:42:29.155341 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-0ccf6d11-0404-4aaa-9a9d-72118b83906a tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:42:29.156296 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-0ccf6d11-0404-4aaa-9a9d-72118b83906a tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] [instance: 5a0a79a6-8e61-477e-8269-730dfb6d04a6] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:42:29.162707 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-0ccf6d11-0404-4aaa-9a9d-72118b83906a tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:42:29.163160 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-0ccf6d11-0404-4aaa-9a9d-72118b83906a tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:42:29.164009 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-0ccf6d11-0404-4aaa-9a9d-72118b83906a tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:42:29.164448 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-0ccf6d11-0404-4aaa-9a9d-72118b83906a tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:42:29.196493 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-0ccf6d11-0404-4aaa-9a9d-72118b83906a tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0a79a6-8e61-477e-8269-730dfb6d04a6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044998 Jun 06 10:42:29.197060 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 240/497] 10.222.0.42 () {60 vars in 1342 bytes} [Mon Jun 6 10:42:29 2022] GET /compute/v2.1/servers/5a0a79a6-8e61-477e-8269-730dfb6d04a6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 06 10:42:30.209016 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-839a4af5-7bde-4b9e-b717-c2b22ffb8c0c tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:42:30.210114 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-839a4af5-7bde-4b9e-b717-c2b22ffb8c0c tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] [instance: 5a0a79a6-8e61-477e-8269-730dfb6d04a6] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:42:30.216851 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-839a4af5-7bde-4b9e-b717-c2b22ffb8c0c tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:42:30.217300 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-839a4af5-7bde-4b9e-b717-c2b22ffb8c0c tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:42:30.218068 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-839a4af5-7bde-4b9e-b717-c2b22ffb8c0c tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:42:30.218507 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-839a4af5-7bde-4b9e-b717-c2b22ffb8c0c tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:42:30.248701 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-839a4af5-7bde-4b9e-b717-c2b22ffb8c0c tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0a79a6-8e61-477e-8269-730dfb6d04a6/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.044127 Jun 06 10:42:30.249247 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 258/498] 10.222.0.42 () {60 vars in 1342 bytes} [Mon Jun 6 10:42:30 2022] GET /compute/v2.1/servers/5a0a79a6-8e61-477e-8269-730dfb6d04a6/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:42:30.306672 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-5d4767a9-df8e-4f9d-80d1-a5a82a21e6f9 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:42:30.307196 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-5d4767a9-df8e-4f9d-80d1-a5a82a21e6f9 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] [instance: 5a0a79a6-8e61-477e-8269-730dfb6d04a6] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:42:30.313664 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-5d4767a9-df8e-4f9d-80d1-a5a82a21e6f9 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:42:30.314381 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-5d4767a9-df8e-4f9d-80d1-a5a82a21e6f9 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:42:30.315216 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-5d4767a9-df8e-4f9d-80d1-a5a82a21e6f9 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:42:30.315646 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-5d4767a9-df8e-4f9d-80d1-a5a82a21e6f9 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:42:30.341427 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-5d4767a9-df8e-4f9d-80d1-a5a82a21e6f9 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] [instance: 5a0a79a6-8e61-477e-8269-730dfb6d04a6] Going to try to terminate instance {{(pid=129350) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 06 10:42:30.417367 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-5d4767a9-df8e-4f9d-80d1-a5a82a21e6f9 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] 10.222.0.42 "DELETE /compute/v2.1/servers/5a0a79a6-8e61-477e-8269-730dfb6d04a6" status: 204 len: 0 microversion: 2.20 time: 0.113895 Jun 06 10:42:30.418062 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 241/499] 10.222.0.42 () {60 vars in 1279 bytes} [Mon Jun 6 10:42:30 2022] DELETE /compute/v2.1/servers/5a0a79a6-8e61-477e-8269-730dfb6d04a6 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 06 10:42:30.426883 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-e4c1f0ae-9e2c-4c0e-a77f-8be741bbad87 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:42:30.427494 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-e4c1f0ae-9e2c-4c0e-a77f-8be741bbad87 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] [instance: 5a0a79a6-8e61-477e-8269-730dfb6d04a6] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:42:30.433439 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-e4c1f0ae-9e2c-4c0e-a77f-8be741bbad87 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:42:30.433874 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-e4c1f0ae-9e2c-4c0e-a77f-8be741bbad87 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:42:30.434624 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-e4c1f0ae-9e2c-4c0e-a77f-8be741bbad87 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:42:30.435063 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-e4c1f0ae-9e2c-4c0e-a77f-8be741bbad87 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:42:30.565163 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-e4c1f0ae-9e2c-4c0e-a77f-8be741bbad87 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:42:30.572917 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-e4c1f0ae-9e2c-4c0e-a77f-8be741bbad87 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:42:30.574405 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-e4c1f0ae-9e2c-4c0e-a77f-8be741bbad87 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:42:30.575535 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-e4c1f0ae-9e2c-4c0e-a77f-8be741bbad87 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0a79a6-8e61-477e-8269-730dfb6d04a6" status: 200 len: 1722 microversion: 2.20 time: 0.152900 Jun 06 10:42:30.576121 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 259/500] 10.222.0.42 () {60 vars in 1276 bytes} [Mon Jun 6 10:42:30 2022] GET /compute/v2.1/servers/5a0a79a6-8e61-477e-8269-730dfb6d04a6 => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 10:42:31.595528 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-04ff81f7-f8d1-4742-8ea1-87070a4f8e59 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:42:31.596436 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-04ff81f7-f8d1-4742-8ea1-87070a4f8e59 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] [instance: 5a0a79a6-8e61-477e-8269-730dfb6d04a6] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:42:31.602870 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-04ff81f7-f8d1-4742-8ea1-87070a4f8e59 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:42:31.603313 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-04ff81f7-f8d1-4742-8ea1-87070a4f8e59 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:42:31.604103 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-04ff81f7-f8d1-4742-8ea1-87070a4f8e59 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:42:31.604534 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-04ff81f7-f8d1-4742-8ea1-87070a4f8e59 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:42:31.732910 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-04ff81f7-f8d1-4742-8ea1-87070a4f8e59 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:42:31.741591 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-04ff81f7-f8d1-4742-8ea1-87070a4f8e59 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:42:31.743109 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-04ff81f7-f8d1-4742-8ea1-87070a4f8e59 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:42:31.744298 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-04ff81f7-f8d1-4742-8ea1-87070a4f8e59 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0a79a6-8e61-477e-8269-730dfb6d04a6" status: 200 len: 1722 microversion: 2.20 time: 0.153597 Jun 06 10:42:31.744857 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 242/501] 10.222.0.42 () {60 vars in 1276 bytes} [Mon Jun 6 10:42:31 2022] GET /compute/v2.1/servers/5a0a79a6-8e61-477e-8269-730dfb6d04a6 => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 10:42:32.013654 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-c72eded9-cfaf-4b50-bf5e-a36c78e2732e tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 10:42:32.014631 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-c72eded9-cfaf-4b50-bf5e-a36c78e2732e tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] [instance: 8e9cb9c1-7df9-4cb7-9121-54bf74f552c7] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:42:32.021485 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-c72eded9-cfaf-4b50-bf5e-a36c78e2732e tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:42:32.021933 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-c72eded9-cfaf-4b50-bf5e-a36c78e2732e tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:42:32.022699 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-c72eded9-cfaf-4b50-bf5e-a36c78e2732e tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:42:32.023176 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-c72eded9-cfaf-4b50-bf5e-a36c78e2732e tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:42:32.096820 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-c72eded9-cfaf-4b50-bf5e-a36c78e2732e tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] 10.222.0.42 "POST /compute/v2.1/servers/8e9cb9c1-7df9-4cb7-9121-54bf74f552c7/action" status: 202 len: 0 microversion: 2.1 time: 0.086411 Jun 06 10:42:32.097453 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 260/502] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Jun 6 10:42:32 2022] POST /compute/v2.1/servers/8e9cb9c1-7df9-4cb7-9121-54bf74f552c7/action => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 06 10:42:32.105535 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-5ff99d5e-cafb-41cf-83d3-7b2d59d1e57c tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:42:32.106149 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-5ff99d5e-cafb-41cf-83d3-7b2d59d1e57c tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] [instance: 8e9cb9c1-7df9-4cb7-9121-54bf74f552c7] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:42:32.113943 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-5ff99d5e-cafb-41cf-83d3-7b2d59d1e57c tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:42:32.114603 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-5ff99d5e-cafb-41cf-83d3-7b2d59d1e57c tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:42:32.115542 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-5ff99d5e-cafb-41cf-83d3-7b2d59d1e57c tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:42:32.116037 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-5ff99d5e-cafb-41cf-83d3-7b2d59d1e57c tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:42:32.454210 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-5ff99d5e-cafb-41cf-83d3-7b2d59d1e57c tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7b11ed004fc4ef3a1f1c48adf31fe8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '645eadf589944a24bf6e27326a61952c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:42:32.462242 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-5ff99d5e-cafb-41cf-83d3-7b2d59d1e57c tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] 10.222.0.42 "GET /compute/v2.1/servers/8e9cb9c1-7df9-4cb7-9121-54bf74f552c7" status: 200 len: 1751 microversion: 2.1 time: 0.360489 Jun 06 10:42:32.462997 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 243/503] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:42:32 2022] GET /compute/v2.1/servers/8e9cb9c1-7df9-4cb7-9121-54bf74f552c7 => generated 1751 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:42:32.763108 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-8addaade-7503-41b8-b916-8d76a3481648 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:42:32.764246 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-8addaade-7503-41b8-b916-8d76a3481648 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] [instance: 5a0a79a6-8e61-477e-8269-730dfb6d04a6] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:42:32.770977 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-8addaade-7503-41b8-b916-8d76a3481648 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:42:32.771424 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-8addaade-7503-41b8-b916-8d76a3481648 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:42:32.772354 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-8addaade-7503-41b8-b916-8d76a3481648 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:42:32.772793 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-8addaade-7503-41b8-b916-8d76a3481648 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:42:33.402394 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-8addaade-7503-41b8-b916-8d76a3481648 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:42:33.410532 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-8addaade-7503-41b8-b916-8d76a3481648 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:42:33.412158 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-8addaade-7503-41b8-b916-8d76a3481648 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:42:33.413377 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-8addaade-7503-41b8-b916-8d76a3481648 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0a79a6-8e61-477e-8269-730dfb6d04a6" status: 200 len: 1722 microversion: 2.20 time: 0.654491 Jun 06 10:42:33.414081 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 261/504] 10.222.0.42 () {60 vars in 1276 bytes} [Mon Jun 6 10:42:32 2022] GET /compute/v2.1/servers/5a0a79a6-8e61-477e-8269-730dfb6d04a6 => generated 1722 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 10:42:33.481406 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-da9a819e-9cee-43df-85bb-c8685848a08c tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:42:33.482012 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-da9a819e-9cee-43df-85bb-c8685848a08c tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] [instance: 8e9cb9c1-7df9-4cb7-9121-54bf74f552c7] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:42:33.489624 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-da9a819e-9cee-43df-85bb-c8685848a08c tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:42:33.490061 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-da9a819e-9cee-43df-85bb-c8685848a08c tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:42:33.490816 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-da9a819e-9cee-43df-85bb-c8685848a08c tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:42:33.491240 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-da9a819e-9cee-43df-85bb-c8685848a08c tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:42:33.506913 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG dbcounter [-] [129350] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=129350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 10:42:33.763509 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-da9a819e-9cee-43df-85bb-c8685848a08c tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7b11ed004fc4ef3a1f1c48adf31fe8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '645eadf589944a24bf6e27326a61952c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:42:33.776724 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-da9a819e-9cee-43df-85bb-c8685848a08c tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] 10.222.0.42 "GET /compute/v2.1/servers/8e9cb9c1-7df9-4cb7-9121-54bf74f552c7" status: 200 len: 1751 microversion: 2.1 time: 0.299069 Jun 06 10:42:33.787921 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 244/505] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:42:33 2022] GET /compute/v2.1/servers/8e9cb9c1-7df9-4cb7-9121-54bf74f552c7 => generated 1751 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:42:33.984196 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [req-5c502b09-7f79-4b00-b05c-c46f7afe4874 req-0712fe07-4c5b-4c63-800b-fcb84ebc986d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a0a79a6-8e61-477e-8269-730dfb6d04a6", "name": "network-vif-deleted", "tag": "581fdfa4-6fbc-445e-ad43-e4ef71127c0e"}]} {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 10:42:33.997285 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [req-5c502b09-7f79-4b00-b05c-c46f7afe4874 req-0712fe07-4c5b-4c63-800b-fcb84ebc986d service nova] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:42:33.998736 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [req-5c502b09-7f79-4b00-b05c-c46f7afe4874 req-0712fe07-4c5b-4c63-800b-fcb84ebc986d service nova] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:42:34.014073 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.compute.server_external_events [req-5c502b09-7f79-4b00-b05c-c46f7afe4874 req-0712fe07-4c5b-4c63-800b-fcb84ebc986d service nova] Creating event network-vif-deleted:581fdfa4-6fbc-445e-ad43-e4ef71127c0e for instance 5a0a79a6-8e61-477e-8269-730dfb6d04a6 on hv-cinder-84482 Jun 06 10:42:34.021939 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [req-5c502b09-7f79-4b00-b05c-c46f7afe4874 req-0712fe07-4c5b-4c63-800b-fcb84ebc986d service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040513 Jun 06 10:42:34.023334 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 262/506] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Jun 6 10:42:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 10:42:34.432582 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-65699614-4f98-4521-befc-ab0d4cc6fd41 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:42:34.433461 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-65699614-4f98-4521-befc-ab0d4cc6fd41 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] [instance: 5a0a79a6-8e61-477e-8269-730dfb6d04a6] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:42:34.441374 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-65699614-4f98-4521-befc-ab0d4cc6fd41 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:42:34.441954 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-65699614-4f98-4521-befc-ab0d4cc6fd41 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:42:34.442989 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-65699614-4f98-4521-befc-ab0d4cc6fd41 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:42:34.443536 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-65699614-4f98-4521-befc-ab0d4cc6fd41 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:42:34.477710 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-65699614-4f98-4521-befc-ab0d4cc6fd41 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:42:34.478453 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-65699614-4f98-4521-befc-ab0d4cc6fd41 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:42:34.479056 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.objects.instance [None req-65699614-4f98-4521-befc-ab0d4cc6fd41 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lazy-loading 'fault' on Instance uuid 5a0a79a6-8e61-477e-8269-730dfb6d04a6 {{(pid=129350) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 06 10:42:34.530442 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-65699614-4f98-4521-befc-ab0d4cc6fd41 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:42:34.541168 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-65699614-4f98-4521-befc-ab0d4cc6fd41 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:42:34.542917 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-65699614-4f98-4521-befc-ab0d4cc6fd41 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:42:34.544112 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-65699614-4f98-4521-befc-ab0d4cc6fd41 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0a79a6-8e61-477e-8269-730dfb6d04a6" status: 200 len: 1371 microversion: 2.20 time: 0.115500 Jun 06 10:42:34.545065 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 245/507] 10.222.0.42 () {60 vars in 1276 bytes} [Mon Jun 6 10:42:34 2022] GET /compute/v2.1/servers/5a0a79a6-8e61-477e-8269-730dfb6d04a6 => generated 1371 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 10:42:34.800062 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-adc191a4-7c7d-4dc6-af31-f054cbd5b8f1 tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:42:34.800759 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-adc191a4-7c7d-4dc6-af31-f054cbd5b8f1 tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] [instance: 8e9cb9c1-7df9-4cb7-9121-54bf74f552c7] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:42:34.810992 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-adc191a4-7c7d-4dc6-af31-f054cbd5b8f1 tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:42:34.811881 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-adc191a4-7c7d-4dc6-af31-f054cbd5b8f1 tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:42:34.812846 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-adc191a4-7c7d-4dc6-af31-f054cbd5b8f1 tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:42:34.813944 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-adc191a4-7c7d-4dc6-af31-f054cbd5b8f1 tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:42:34.971619 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-adc191a4-7c7d-4dc6-af31-f054cbd5b8f1 tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7b11ed004fc4ef3a1f1c48adf31fe8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '645eadf589944a24bf6e27326a61952c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:42:34.980229 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-adc191a4-7c7d-4dc6-af31-f054cbd5b8f1 tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] 10.222.0.42 "GET /compute/v2.1/servers/8e9cb9c1-7df9-4cb7-9121-54bf74f552c7" status: 200 len: 1756 microversion: 2.1 time: 0.189165 Jun 06 10:42:34.981121 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 263/508] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:42:34 2022] GET /compute/v2.1/servers/8e9cb9c1-7df9-4cb7-9121-54bf74f552c7 => generated 1756 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:42:35.562532 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-c3271720-6a85-4540-be57-a821f11b847d tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:42:35.563043 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-c3271720-6a85-4540-be57-a821f11b847d tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] [instance: 5a0a79a6-8e61-477e-8269-730dfb6d04a6] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:42:35.569766 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-c3271720-6a85-4540-be57-a821f11b847d tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:42:35.570211 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-c3271720-6a85-4540-be57-a821f11b847d tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:42:35.570981 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-c3271720-6a85-4540-be57-a821f11b847d tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:42:35.571414 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-c3271720-6a85-4540-be57-a821f11b847d tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:42:35.585273 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.wsgi [None req-c3271720-6a85-4540-be57-a821f11b847d tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] HTTP exception thrown: Instance 5a0a79a6-8e61-477e-8269-730dfb6d04a6 could not be found. Jun 06 10:42:35.586953 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-c3271720-6a85-4540-be57-a821f11b847d tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Request method failure captured: Jun 06 10:42:35.586953 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: request: GET /compute/v2.1/servers/5a0a79a6-8e61-477e-8269-730dfb6d04a6 HTTP/1.1 Jun 06 10:42:35.586953 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: Accept: application/json Jun 06 10:42:35.586953 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: Accept-Encoding: identity Jun 06 10:42:35.586953 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: Connection: close Jun 06 10:42:35.586953 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: Content-Length: 0 Jun 06 10:42:35.586953 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: Content-Type: application/json Jun 06 10:42:35.586953 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: Host: 10.222.0.42 Jun 06 10:42:35.586953 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: Openstack-System-Scope: None Jun 06 10:42:35.586953 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: User-Agent: python-urllib3/1.26.9 Jun 06 10:42:35.586953 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Auth-Token: gAAAAABindkhk5HbPnki7y1mOF6QUbJfXveFJ_2Wi9Hiz8dbxNdA9mGyY-H1VvWvTiOq5i5SKl6hrS6-TjUJXxUfQ_bK7qtIQnMt1h20Q32dUKhA145SHE6n7VRD60I14diW4E6VB9ewqHQrPJl1un6U-mxcj9EU1AW2pM58-0NCiMNK7S6xGq0 Jun 06 10:42:35.586953 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Domain-Id: None Jun 06 10:42:35.586953 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Domain-Name: None Jun 06 10:42:35.586953 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Identity-Status: Confirmed Jun 06 10:42:35.586953 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Is-Admin-Project: True Jun 06 10:42:35.586953 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Openstack-Nova-Api-Version: 2.20 Jun 06 10:42:35.586953 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Project-Domain-Id: default Jun 06 10:42:35.586953 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Project-Domain-Name: Default Jun 06 10:42:35.586953 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Project-Id: 4905170c438f456182ba201316a64029 Jun 06 10:42:35.586953 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1675012870 Jun 06 10:42:35.586953 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Role: member,reader Jun 06 10:42:35.586953 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Roles: member,reader Jun 06 10:42:35.588569 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/4905170c438f456182ba201316a64029"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4905170c438f456182ba201316a64029"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4905170c438f456182ba201316a64029"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_4905170c438f456182ba201316a64029", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Jun 06 10:42:35.588569 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1675012870 Jun 06 10:42:35.588569 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Tenant-Id: 4905170c438f456182ba201316a64029 Jun 06 10:42:35.588569 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1675012870 Jun 06 10:42:35.588569 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-User: tempest-AttachVolumeShelveTestJSON-1675012870-project Jun 06 10:42:35.588569 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-User-Domain-Id: default Jun 06 10:42:35.588569 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-User-Domain-Name: Default Jun 06 10:42:35.588569 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-User-Id: ea1482ba53554f71865cea46ffbac23c Jun 06 10:42:35.588569 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1675012870-project Jun 06 10:42:35.588569 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: method: > Jun 06 10:42:35.588569 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: exception: Instance 5a0a79a6-8e61-477e-8269-730dfb6d04a6 could not be found. Jun 06 10:42:35.588569 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: action_args: {'id': '5a0a79a6-8e61-477e-8269-730dfb6d04a6'} Jun 06 10:42:35.589369 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 10:42:35.589369 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 10:42:35.589369 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 06 10:42:35.589369 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 06 10:42:35.589369 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 06 10:42:35.589369 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 06 10:42:35.589369 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 06 10:42:35.589369 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 06 10:42:35.589369 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 06 10:42:35.589369 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 06 10:42:35.589369 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5a0a79a6-8e61-477e-8269-730dfb6d04a6 could not be found. Jun 06 10:42:35.589369 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi Jun 06 10:42:35.589369 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 10:42:35.589369 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi Jun 06 10:42:35.589369 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 10:42:35.589369 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 10:42:35.589369 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 10:42:35.589369 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 10:42:35.589369 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 10:42:35.589369 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 10:42:35.590514 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 10:42:35.590514 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 06 10:42:35.590514 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 06 10:42:35.590514 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 06 10:42:35.590514 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 06 10:42:35.590514 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 06 10:42:35.590514 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 06 10:42:35.590514 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5a0a79a6-8e61-477e-8269-730dfb6d04a6 could not be found. Jun 06 10:42:35.590514 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi Jun 06 10:42:35.590514 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 10:42:35.590514 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi Jun 06 10:42:35.590514 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 10:42:35.590514 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 10:42:35.590514 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 10:42:35.590514 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 10:42:35.590514 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 10:42:35.590514 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5a0a79a6-8e61-477e-8269-730dfb6d04a6 could not be found. Jun 06 10:42:35.590514 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi Jun 06 10:42:35.591579 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-c3271720-6a85-4540-be57-a821f11b847d tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Returning 404 to user: Instance 5a0a79a6-8e61-477e-8269-730dfb6d04a6 could not be found. {{(pid=129350) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 10:42:35.591579 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-c3271720-6a85-4540-be57-a821f11b847d tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0a79a6-8e61-477e-8269-730dfb6d04a6" status: 404 len: 111 microversion: 2.20 time: 0.029914 Jun 06 10:42:35.591579 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 246/509] 10.222.0.42 () {60 vars in 1276 bytes} [Mon Jun 6 10:42:35 2022] GET /compute/v2.1/servers/5a0a79a6-8e61-477e-8269-730dfb6d04a6 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 06 10:42:35.598479 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-6ffc0211-914c-49e0-b95f-574036080782 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Calling method '.version_select at 0x7f8fd37e81f0>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:42:35.617487 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-6ffc0211-914c-49e0-b95f-574036080782 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-195121733" status: 204 len: 0 microversion: 2.20 time: 0.023802 Jun 06 10:42:35.618271 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 264/510] 10.222.0.42 () {60 vars in 1258 bytes} [Mon Jun 6 10:42:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-195121733 => generated 0 bytes in 25 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 06 10:42:35.997211 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-ce6319a5-59c5-446e-a66c-d980f2b9fc5e tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:42:35.997827 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-ce6319a5-59c5-446e-a66c-d980f2b9fc5e tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] [instance: 8e9cb9c1-7df9-4cb7-9121-54bf74f552c7] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:42:36.004697 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-ce6319a5-59c5-446e-a66c-d980f2b9fc5e tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:42:36.005138 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-ce6319a5-59c5-446e-a66c-d980f2b9fc5e tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:42:36.006126 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-ce6319a5-59c5-446e-a66c-d980f2b9fc5e tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:42:36.006557 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-ce6319a5-59c5-446e-a66c-d980f2b9fc5e tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:42:36.161868 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-ce6319a5-59c5-446e-a66c-d980f2b9fc5e tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7b11ed004fc4ef3a1f1c48adf31fe8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '645eadf589944a24bf6e27326a61952c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:42:36.170337 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-ce6319a5-59c5-446e-a66c-d980f2b9fc5e tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] 10.222.0.42 "GET /compute/v2.1/servers/8e9cb9c1-7df9-4cb7-9121-54bf74f552c7" status: 200 len: 1756 microversion: 2.1 time: 0.177100 Jun 06 10:42:36.170897 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 247/511] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:42:35 2022] GET /compute/v2.1/servers/8e9cb9c1-7df9-4cb7-9121-54bf74f552c7 => generated 1756 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:42:36.321967 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-80e42e0c-20a3-498a-bfcb-7811769603e4 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Action: 'create', calling method: .version_select at 0x7f8fd374f5e0>, body: {"keypair": {"name": "tempest-keypair-991877977", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOdFtVrB86zdoQDUxo87Wy2a7MaPdG7pT+Bwl5frAQ+hULZTuy37bBSfkbzc/ZYj9bQJ9Y5Q0I9L/L+jLeJddWfeQKBrnOo7ZkDcZfklUeqxLJ+dVK/nqNLD6ppueNVodw=="}} {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 10:42:36.326382 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG dbcounter [-] [129349] Writing DB stats nova_api:SELECT=37,nova_api:DELETE=1 {{(pid=129349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 10:42:36.339369 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.quota [None req-80e42e0c-20a3-498a-bfcb-7811769603e4 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Getting quotas for project 4905170c438f456182ba201316a64029. Resources: {'key_pairs'} {{(pid=129349) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 06 10:42:36.343695 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.quota [None req-80e42e0c-20a3-498a-bfcb-7811769603e4 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Getting quotas for user ea1482ba53554f71865cea46ffbac23c and project 4905170c438f456182ba201316a64029. Resources: {'key_pairs'} {{(pid=129349) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 06 10:42:36.369506 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-80e42e0c-20a3-498a-bfcb-7811769603e4 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.051480 Jun 06 10:42:36.370133 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 265/512] 10.222.0.42 () {62 vars in 1199 bytes} [Mon Jun 6 10:42:36 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 53 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 06 10:42:36.503396 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-5d85aeb9-98bf-4f14-9472-c519faeaccf0 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:42:36.504427 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-5d85aeb9-98bf-4f14-9472-c519faeaccf0 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] [instance: f49079c1-1384-4136-b6cf-eadc40fb5aa1] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:42:36.511551 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-5d85aeb9-98bf-4f14-9472-c519faeaccf0 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:42:36.512177 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-5d85aeb9-98bf-4f14-9472-c519faeaccf0 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:42:36.513446 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-5d85aeb9-98bf-4f14-9472-c519faeaccf0 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:42:36.514086 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-5d85aeb9-98bf-4f14-9472-c519faeaccf0 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:42:36.551008 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-5d85aeb9-98bf-4f14-9472-c519faeaccf0 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] 10.222.0.42 "GET /compute/v2.1/servers/f49079c1-1384-4136-b6cf-eadc40fb5aa1/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.052640 Jun 06 10:42:36.552056 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 248/513] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jun 6 10:42:36 2022] GET /compute/v2.1/servers/f49079c1-1384-4136-b6cf-eadc40fb5aa1/os-volume_attachments => generated 25 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 06 10:42:36.623763 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-25f15ce7-1cd1-4765-ba67-0f7170c04a0f tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:42:36.624283 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-25f15ce7-1cd1-4765-ba67-0f7170c04a0f tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] [instance: f49079c1-1384-4136-b6cf-eadc40fb5aa1] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:42:36.633323 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-25f15ce7-1cd1-4765-ba67-0f7170c04a0f tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:42:36.634023 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-25f15ce7-1cd1-4765-ba67-0f7170c04a0f tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:42:36.635036 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-25f15ce7-1cd1-4765-ba67-0f7170c04a0f tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:42:36.635652 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-25f15ce7-1cd1-4765-ba67-0f7170c04a0f tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:42:36.663431 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-25f15ce7-1cd1-4765-ba67-0f7170c04a0f tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] [instance: f49079c1-1384-4136-b6cf-eadc40fb5aa1] Going to try to terminate instance {{(pid=129349) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 06 10:42:36.761932 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-25f15ce7-1cd1-4765-ba67-0f7170c04a0f tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] 10.222.0.42 "DELETE /compute/v2.1/servers/f49079c1-1384-4136-b6cf-eadc40fb5aa1" status: 204 len: 0 microversion: 2.1 time: 0.142078 Jun 06 10:42:36.762552 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 266/514] 10.222.0.42 () {58 vars in 1238 bytes} [Mon Jun 6 10:42:36 2022] DELETE /compute/v2.1/servers/f49079c1-1384-4136-b6cf-eadc40fb5aa1 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 06 10:42:36.771766 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-33a4d591-5dec-4e57-a7d6-4d6f1d4f6747 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:42:36.772429 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-33a4d591-5dec-4e57-a7d6-4d6f1d4f6747 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] [instance: f49079c1-1384-4136-b6cf-eadc40fb5aa1] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:42:36.779197 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-33a4d591-5dec-4e57-a7d6-4d6f1d4f6747 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:42:36.779670 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-33a4d591-5dec-4e57-a7d6-4d6f1d4f6747 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:42:36.780454 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-33a4d591-5dec-4e57-a7d6-4d6f1d4f6747 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:42:36.781058 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-33a4d591-5dec-4e57-a7d6-4d6f1d4f6747 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:42:36.917821 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-33a4d591-5dec-4e57-a7d6-4d6f1d4f6747 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b7d82c999646b6b6b96d565f0e3f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe30c756a2f84166ad23af1edf83157e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:42:36.926473 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-33a4d591-5dec-4e57-a7d6-4d6f1d4f6747 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] 10.222.0.42 "GET /compute/v2.1/servers/f49079c1-1384-4136-b6cf-eadc40fb5aa1" status: 200 len: 1672 microversion: 2.1 time: 0.159058 Jun 06 10:42:36.927032 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 249/515] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:42:36 2022] GET /compute/v2.1/servers/f49079c1-1384-4136-b6cf-eadc40fb5aa1 => generated 1672 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:42:37.189414 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-cf6ea560-f4af-435b-8dad-c9e6e32f09ec tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:42:37.190391 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-cf6ea560-f4af-435b-8dad-c9e6e32f09ec tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] [instance: 8e9cb9c1-7df9-4cb7-9121-54bf74f552c7] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:42:37.196773 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-cf6ea560-f4af-435b-8dad-c9e6e32f09ec tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:42:37.197228 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-cf6ea560-f4af-435b-8dad-c9e6e32f09ec tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:42:37.197995 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-cf6ea560-f4af-435b-8dad-c9e6e32f09ec tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:42:37.198611 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-cf6ea560-f4af-435b-8dad-c9e6e32f09ec tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:42:37.355531 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-cf6ea560-f4af-435b-8dad-c9e6e32f09ec tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7b11ed004fc4ef3a1f1c48adf31fe8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '645eadf589944a24bf6e27326a61952c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:42:37.364147 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-cf6ea560-f4af-435b-8dad-c9e6e32f09ec tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] 10.222.0.42 "GET /compute/v2.1/servers/8e9cb9c1-7df9-4cb7-9121-54bf74f552c7" status: 200 len: 1756 microversion: 2.1 time: 0.179955 Jun 06 10:42:37.364744 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 267/516] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:42:37 2022] GET /compute/v2.1/servers/8e9cb9c1-7df9-4cb7-9121-54bf74f552c7 => generated 1756 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:42:37.745350 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-5a045e1b-765b-43d3-af0d-dcf44188ee39 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-104978805", "imageRef": "6eea2d98-354d-4083-b74c-abcbb97f9e1a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "0be38b0d-7530-4917-a019-0b1399ba4500"}], "security_groups": [{"name": "tempest-securitygroup--1913658261"}], "key_name": "tempest-keypair-991877977", "user_data": "}} {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 10:42:37.751867 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG dbcounter [-] [129350] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1 {{(pid=129350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 10:42:37.846815 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.network.neutron [None req-5a045e1b-765b-43d3-af0d-dcf44188ee39 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] validate_networks() for [('0be38b0d-7530-4917-a019-0b1399ba4500', None, None, None, None, None)] {{(pid=129350) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 06 10:42:37.943815 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-1749a068-5ba7-4c6a-98ae-c95c2d08e2eb tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:42:37.944528 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-1749a068-5ba7-4c6a-98ae-c95c2d08e2eb tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] [instance: f49079c1-1384-4136-b6cf-eadc40fb5aa1] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:42:37.950479 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-1749a068-5ba7-4c6a-98ae-c95c2d08e2eb tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:42:37.950922 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-1749a068-5ba7-4c6a-98ae-c95c2d08e2eb tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:42:37.951751 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-1749a068-5ba7-4c6a-98ae-c95c2d08e2eb tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:42:37.952121 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-1749a068-5ba7-4c6a-98ae-c95c2d08e2eb tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:42:38.168828 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-1749a068-5ba7-4c6a-98ae-c95c2d08e2eb tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b7d82c999646b6b6b96d565f0e3f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe30c756a2f84166ad23af1edf83157e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:42:38.176410 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-1749a068-5ba7-4c6a-98ae-c95c2d08e2eb tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] 10.222.0.42 "GET /compute/v2.1/servers/f49079c1-1384-4136-b6cf-eadc40fb5aa1" status: 200 len: 1672 microversion: 2.1 time: 0.236400 Jun 06 10:42:38.176986 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 268/517] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:42:37 2022] GET /compute/v2.1/servers/f49079c1-1384-4136-b6cf-eadc40fb5aa1 => generated 1672 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 10:42:38.281252 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.virt.hardware [None req-5a045e1b-765b-43d3-af0d-dcf44188ee39 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Flavor limits 0:0:0 {{(pid=129350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 06 10:42:38.281669 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.virt.hardware [None req-5a045e1b-765b-43d3-af0d-dcf44188ee39 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Image limits 0:0:0 {{(pid=129350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 06 10:42:38.282491 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.virt.hardware [None req-5a045e1b-765b-43d3-af0d-dcf44188ee39 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Flavor pref 0:0:0 {{(pid=129350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 06 10:42:38.282929 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.virt.hardware [None req-5a045e1b-765b-43d3-af0d-dcf44188ee39 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Image pref 0:0:0 {{(pid=129350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 06 10:42:38.283338 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.virt.hardware [None req-5a045e1b-765b-43d3-af0d-dcf44188ee39 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 06 10:42:38.292926 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-5a045e1b-765b-43d3-af0d-dcf44188ee39 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:42:38.293369 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-5a045e1b-765b-43d3-af0d-dcf44188ee39 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:42:38.294161 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-5a045e1b-765b-43d3-af0d-dcf44188ee39 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:42:38.294591 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-5a045e1b-765b-43d3-af0d-dcf44188ee39 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:42:38.312698 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.quota [None req-5a045e1b-765b-43d3-af0d-dcf44188ee39 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Getting quotas for project 4905170c438f456182ba201316a64029. Resources: {'ram', 'cores', 'instances'} {{(pid=129350) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 06 10:42:38.319212 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.quota [None req-5a045e1b-765b-43d3-af0d-dcf44188ee39 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Getting quotas for user ea1482ba53554f71865cea46ffbac23c and project 4905170c438f456182ba201316a64029. Resources: {'ram', 'cores', 'instances'} {{(pid=129350) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 06 10:42:38.331126 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-5a045e1b-765b-43d3-af0d-dcf44188ee39 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Going to run 1 instances... {{(pid=129350) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 06 10:42:38.333397 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-5a045e1b-765b-43d3-af0d-dcf44188ee39 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] [instance: ce3b66f8-03e9-4d5f-8c40-d1a887b12304] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6eea2d98-354d-4083-b74c-abcbb97f9e1a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129350) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 06 10:42:38.382037 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-5a045e1b-765b-43d3-af0d-dcf44188ee39 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.640926 Jun 06 10:42:38.382371 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-c577d344-67b9-4dbb-84fe-35e96fe417de tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:42:38.383100 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-c577d344-67b9-4dbb-84fe-35e96fe417de tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] [instance: 8e9cb9c1-7df9-4cb7-9121-54bf74f552c7] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:42:38.388058 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 250/518] 10.222.0.42 () {62 vars in 1187 bytes} [Mon Jun 6 10:42:37 2022] POST /compute/v2.1/servers => generated 402 bytes in 647 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 06 10:42:38.390965 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-c577d344-67b9-4dbb-84fe-35e96fe417de tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:42:38.392203 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-c577d344-67b9-4dbb-84fe-35e96fe417de tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:42:38.393058 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-c577d344-67b9-4dbb-84fe-35e96fe417de tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:42:38.393622 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-c577d344-67b9-4dbb-84fe-35e96fe417de tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:42:38.393925 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-ea65c9e8-c641-44a9-b3bd-f3f1f7725a59 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:42:38.394532 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-ea65c9e8-c641-44a9-b3bd-f3f1f7725a59 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] [instance: ce3b66f8-03e9-4d5f-8c40-d1a887b12304] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:42:38.476931 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-ea65c9e8-c641-44a9-b3bd-f3f1f7725a59 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:42:38.485723 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-ea65c9e8-c641-44a9-b3bd-f3f1f7725a59 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:42:38.487461 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-ea65c9e8-c641-44a9-b3bd-f3f1f7725a59 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:42:38.488655 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-ea65c9e8-c641-44a9-b3bd-f3f1f7725a59 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] 10.222.0.42 "GET /compute/v2.1/servers/ce3b66f8-03e9-4d5f-8c40-d1a887b12304" status: 200 len: 1280 microversion: 2.20 time: 0.099528 Jun 06 10:42:38.490500 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 251/519] 10.222.0.42 () {60 vars in 1276 bytes} [Mon Jun 6 10:42:38 2022] GET /compute/v2.1/servers/ce3b66f8-03e9-4d5f-8c40-d1a887b12304 => generated 1280 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 10:42:38.559147 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-c577d344-67b9-4dbb-84fe-35e96fe417de tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7b11ed004fc4ef3a1f1c48adf31fe8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '645eadf589944a24bf6e27326a61952c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:42:38.568611 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-c577d344-67b9-4dbb-84fe-35e96fe417de tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] 10.222.0.42 "GET /compute/v2.1/servers/8e9cb9c1-7df9-4cb7-9121-54bf74f552c7" status: 200 len: 1756 microversion: 2.1 time: 0.190634 Jun 06 10:42:38.569205 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 269/520] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:42:38 2022] GET /compute/v2.1/servers/8e9cb9c1-7df9-4cb7-9121-54bf74f552c7 => generated 1756 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 10:42:39.194491 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-cb8aaa78-8540-4366-b510-0813e62c4f6c tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:42:39.195193 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-cb8aaa78-8540-4366-b510-0813e62c4f6c tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] [instance: f49079c1-1384-4136-b6cf-eadc40fb5aa1] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:42:39.201763 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-cb8aaa78-8540-4366-b510-0813e62c4f6c tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:42:39.202219 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-cb8aaa78-8540-4366-b510-0813e62c4f6c tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:42:39.202988 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-cb8aaa78-8540-4366-b510-0813e62c4f6c tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:42:39.203443 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-cb8aaa78-8540-4366-b510-0813e62c4f6c tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:42:39.481434 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-cb8aaa78-8540-4366-b510-0813e62c4f6c tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b7d82c999646b6b6b96d565f0e3f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe30c756a2f84166ad23af1edf83157e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:42:39.500010 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-cb8aaa78-8540-4366-b510-0813e62c4f6c tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] 10.222.0.42 "GET /compute/v2.1/servers/f49079c1-1384-4136-b6cf-eadc40fb5aa1" status: 200 len: 1672 microversion: 2.1 time: 0.309427 Jun 06 10:42:39.501254 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 252/521] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:42:39 2022] GET /compute/v2.1/servers/f49079c1-1384-4136-b6cf-eadc40fb5aa1 => generated 1672 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:42:39.509496 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-92082810-bc4a-4dc7-a197-778954e7bea8 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:42:39.510744 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-92082810-bc4a-4dc7-a197-778954e7bea8 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] [instance: ce3b66f8-03e9-4d5f-8c40-d1a887b12304] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:42:39.519297 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-92082810-bc4a-4dc7-a197-778954e7bea8 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:42:39.519734 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-92082810-bc4a-4dc7-a197-778954e7bea8 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:42:39.520546 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-92082810-bc4a-4dc7-a197-778954e7bea8 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:42:39.520972 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-92082810-bc4a-4dc7-a197-778954e7bea8 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:42:39.585440 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-019e9181-3449-4fe2-80b4-24ca3ce0cdf1 tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:42:39.586630 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-019e9181-3449-4fe2-80b4-24ca3ce0cdf1 tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] [instance: 8e9cb9c1-7df9-4cb7-9121-54bf74f552c7] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:42:39.593241 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-019e9181-3449-4fe2-80b4-24ca3ce0cdf1 tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:42:39.593658 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-019e9181-3449-4fe2-80b4-24ca3ce0cdf1 tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:42:39.595028 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-019e9181-3449-4fe2-80b4-24ca3ce0cdf1 tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:42:39.595464 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-019e9181-3449-4fe2-80b4-24ca3ce0cdf1 tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:42:39.607593 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-92082810-bc4a-4dc7-a197-778954e7bea8 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:42:39.612366 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG dbcounter [-] [129349] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=129349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 10:42:39.618841 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-92082810-bc4a-4dc7-a197-778954e7bea8 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:42:39.620697 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-92082810-bc4a-4dc7-a197-778954e7bea8 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:42:39.621876 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-92082810-bc4a-4dc7-a197-778954e7bea8 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] 10.222.0.42 "GET /compute/v2.1/servers/ce3b66f8-03e9-4d5f-8c40-d1a887b12304" status: 200 len: 1350 microversion: 2.20 time: 0.119037 Jun 06 10:42:39.622588 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 270/522] 10.222.0.42 () {60 vars in 1276 bytes} [Mon Jun 6 10:42:39 2022] GET /compute/v2.1/servers/ce3b66f8-03e9-4d5f-8c40-d1a887b12304 => generated 1350 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 10:42:39.899587 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-019e9181-3449-4fe2-80b4-24ca3ce0cdf1 tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7b11ed004fc4ef3a1f1c48adf31fe8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '645eadf589944a24bf6e27326a61952c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:42:39.907730 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-019e9181-3449-4fe2-80b4-24ca3ce0cdf1 tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] 10.222.0.42 "GET /compute/v2.1/servers/8e9cb9c1-7df9-4cb7-9121-54bf74f552c7" status: 200 len: 1756 microversion: 2.1 time: 0.325988 Jun 06 10:42:39.908464 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 253/523] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:42:39 2022] GET /compute/v2.1/servers/8e9cb9c1-7df9-4cb7-9121-54bf74f552c7 => generated 1756 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 10:42:40.266062 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [req-ef5a7eb0-3367-46c8-bf6e-90ea52d4f1e7 req-f0223a42-170a-439d-855c-336380e78080 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f49079c1-1384-4136-b6cf-eadc40fb5aa1", "name": "network-vif-deleted", "tag": "c68a8af3-23cf-4f43-8b21-304f27c84919"}]} {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 10:42:40.275379 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [req-ef5a7eb0-3367-46c8-bf6e-90ea52d4f1e7 req-f0223a42-170a-439d-855c-336380e78080 service nova] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:42:40.276115 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [req-ef5a7eb0-3367-46c8-bf6e-90ea52d4f1e7 req-f0223a42-170a-439d-855c-336380e78080 service nova] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:42:40.301094 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.compute.server_external_events [req-ef5a7eb0-3367-46c8-bf6e-90ea52d4f1e7 req-f0223a42-170a-439d-855c-336380e78080 service nova] Creating event network-vif-deleted:c68a8af3-23cf-4f43-8b21-304f27c84919 for instance f49079c1-1384-4136-b6cf-eadc40fb5aa1 on hv-cinder-84482 Jun 06 10:42:40.306600 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [req-ef5a7eb0-3367-46c8-bf6e-90ea52d4f1e7 req-f0223a42-170a-439d-855c-336380e78080 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044731 Jun 06 10:42:40.307733 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 271/524] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Jun 6 10:42:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 10:42:40.519928 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-2fef7bfc-ede4-4411-9a35-45a8758e1985 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:42:40.521726 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-2fef7bfc-ede4-4411-9a35-45a8758e1985 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] [instance: f49079c1-1384-4136-b6cf-eadc40fb5aa1] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:42:40.529357 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-2fef7bfc-ede4-4411-9a35-45a8758e1985 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:42:40.530411 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-2fef7bfc-ede4-4411-9a35-45a8758e1985 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:42:40.531345 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-2fef7bfc-ede4-4411-9a35-45a8758e1985 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:42:40.532646 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-2fef7bfc-ede4-4411-9a35-45a8758e1985 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:42:40.569090 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-2fef7bfc-ede4-4411-9a35-45a8758e1985 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:42:40.570007 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-2fef7bfc-ede4-4411-9a35-45a8758e1985 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:42:40.570624 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.objects.instance [None req-2fef7bfc-ede4-4411-9a35-45a8758e1985 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lazy-loading 'fault' on Instance uuid f49079c1-1384-4136-b6cf-eadc40fb5aa1 {{(pid=129350) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 06 10:42:40.634787 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-2fef7bfc-ede4-4411-9a35-45a8758e1985 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b7d82c999646b6b6b96d565f0e3f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe30c756a2f84166ad23af1edf83157e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:42:40.646535 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-2fef7bfc-ede4-4411-9a35-45a8758e1985 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] 10.222.0.42 "GET /compute/v2.1/servers/f49079c1-1384-4136-b6cf-eadc40fb5aa1" status: 200 len: 1327 microversion: 2.1 time: 0.133050 Jun 06 10:42:40.648126 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 254/525] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:42:40 2022] GET /compute/v2.1/servers/f49079c1-1384-4136-b6cf-eadc40fb5aa1 => generated 1327 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:42:40.657421 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-889946b5-4331-4d24-b8cb-5bd03b975bb1 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:42:40.658903 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-889946b5-4331-4d24-b8cb-5bd03b975bb1 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] [instance: ce3b66f8-03e9-4d5f-8c40-d1a887b12304] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:42:40.670908 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-889946b5-4331-4d24-b8cb-5bd03b975bb1 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:42:40.671358 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-889946b5-4331-4d24-b8cb-5bd03b975bb1 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:42:40.673733 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-889946b5-4331-4d24-b8cb-5bd03b975bb1 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:42:40.674222 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-889946b5-4331-4d24-b8cb-5bd03b975bb1 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:42:40.926005 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-c9faedbe-34f4-4de5-9914-aedac57bfda6 tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:42:40.926854 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-c9faedbe-34f4-4de5-9914-aedac57bfda6 tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] [instance: 8e9cb9c1-7df9-4cb7-9121-54bf74f552c7] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:42:40.934823 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-c9faedbe-34f4-4de5-9914-aedac57bfda6 tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:42:40.935575 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-c9faedbe-34f4-4de5-9914-aedac57bfda6 tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:42:40.936583 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-c9faedbe-34f4-4de5-9914-aedac57bfda6 tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:42:40.937226 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-c9faedbe-34f4-4de5-9914-aedac57bfda6 tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:42:40.965123 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-889946b5-4331-4d24-b8cb-5bd03b975bb1 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:42:40.974976 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-889946b5-4331-4d24-b8cb-5bd03b975bb1 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:42:40.976678 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-889946b5-4331-4d24-b8cb-5bd03b975bb1 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:42:40.977980 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-889946b5-4331-4d24-b8cb-5bd03b975bb1 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] 10.222.0.42 "GET /compute/v2.1/servers/ce3b66f8-03e9-4d5f-8c40-d1a887b12304" status: 200 len: 1406 microversion: 2.20 time: 0.339910 Jun 06 10:42:40.978612 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 272/526] 10.222.0.42 () {60 vars in 1276 bytes} [Mon Jun 6 10:42:40 2022] GET /compute/v2.1/servers/ce3b66f8-03e9-4d5f-8c40-d1a887b12304 => generated 1406 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 10:42:41.232220 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-c9faedbe-34f4-4de5-9914-aedac57bfda6 tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7b11ed004fc4ef3a1f1c48adf31fe8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '645eadf589944a24bf6e27326a61952c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:42:41.241607 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-c9faedbe-34f4-4de5-9914-aedac57bfda6 tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] 10.222.0.42 "GET /compute/v2.1/servers/8e9cb9c1-7df9-4cb7-9121-54bf74f552c7" status: 200 len: 1756 microversion: 2.1 time: 0.320391 Jun 06 10:42:41.242191 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 255/527] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:42:40 2022] GET /compute/v2.1/servers/8e9cb9c1-7df9-4cb7-9121-54bf74f552c7 => generated 1756 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 10:42:41.664914 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-783f73aa-9662-4960-9cf2-d599762080f6 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:42:41.665566 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-783f73aa-9662-4960-9cf2-d599762080f6 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] [instance: f49079c1-1384-4136-b6cf-eadc40fb5aa1] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:42:41.672786 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-783f73aa-9662-4960-9cf2-d599762080f6 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:42:41.672786 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-783f73aa-9662-4960-9cf2-d599762080f6 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:42:41.673540 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-783f73aa-9662-4960-9cf2-d599762080f6 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:42:41.677317 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-783f73aa-9662-4960-9cf2-d599762080f6 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:42:41.695622 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.wsgi [None req-783f73aa-9662-4960-9cf2-d599762080f6 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] HTTP exception thrown: Instance f49079c1-1384-4136-b6cf-eadc40fb5aa1 could not be found. Jun 06 10:42:41.697404 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-783f73aa-9662-4960-9cf2-d599762080f6 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Request method failure captured: Jun 06 10:42:41.697404 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: request: GET /compute/v2.1/servers/f49079c1-1384-4136-b6cf-eadc40fb5aa1 HTTP/1.1 Jun 06 10:42:41.697404 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: Accept: application/json Jun 06 10:42:41.697404 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: Accept-Encoding: identity Jun 06 10:42:41.697404 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: Connection: close Jun 06 10:42:41.697404 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: Content-Length: 0 Jun 06 10:42:41.697404 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: Content-Type: application/json Jun 06 10:42:41.697404 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: Host: 10.222.0.42 Jun 06 10:42:41.697404 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: Openstack-System-Scope: None Jun 06 10:42:41.697404 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: User-Agent: python-urllib3/1.26.9 Jun 06 10:42:41.697404 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Auth-Token: gAAAAABindkVPjrYNfw4lPsEvV1DBkHMzfkzFcyl0PyTEflxsUZ_Idryl7a4K8E8CJs1-vn_w0uzUKdIkJQlPXesaauws6VIJTys9Kf8RqH7iedIpqv26wdHSTgW5jSML0WcIhjjHUbF_ZfSWrR7_BgUv3p0oLs7MsYkczQVx5aDUHcMInlAF3U Jun 06 10:42:41.697404 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Domain-Id: None Jun 06 10:42:41.697404 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Domain-Name: None Jun 06 10:42:41.697404 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Identity-Status: Confirmed Jun 06 10:42:41.697404 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Is-Admin-Project: True Jun 06 10:42:41.697404 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Project-Domain-Id: default Jun 06 10:42:41.697404 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Project-Domain-Name: Default Jun 06 10:42:41.697404 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Project-Id: fe30c756a2f84166ad23af1edf83157e Jun 06 10:42:41.697404 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Project-Name: tempest-AttachVolumeTestJSON-489641414 Jun 06 10:42:41.697404 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Role: member,reader Jun 06 10:42:41.697404 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Roles: member,reader Jun 06 10:42:41.698808 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/fe30c756a2f84166ad23af1edf83157e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/fe30c756a2f84166ad23af1edf83157e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/fe30c756a2f84166ad23af1edf83157e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_fe30c756a2f84166ad23af1edf83157e", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Jun 06 10:42:41.698808 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Tenant: tempest-AttachVolumeTestJSON-489641414 Jun 06 10:42:41.698808 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Tenant-Id: fe30c756a2f84166ad23af1edf83157e Jun 06 10:42:41.698808 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Tenant-Name: tempest-AttachVolumeTestJSON-489641414 Jun 06 10:42:41.698808 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-User: tempest-AttachVolumeTestJSON-489641414-project Jun 06 10:42:41.698808 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-User-Domain-Id: default Jun 06 10:42:41.698808 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-User-Domain-Name: Default Jun 06 10:42:41.698808 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-User-Id: f6b7d82c999646b6b6b96d565f0e3f9a Jun 06 10:42:41.698808 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-User-Name: tempest-AttachVolumeTestJSON-489641414-project Jun 06 10:42:41.698808 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: method: > Jun 06 10:42:41.698808 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: exception: Instance f49079c1-1384-4136-b6cf-eadc40fb5aa1 could not be found. Jun 06 10:42:41.698808 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: action_args: {'id': 'f49079c1-1384-4136-b6cf-eadc40fb5aa1'} Jun 06 10:42:41.699594 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 10:42:41.699594 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 10:42:41.699594 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 06 10:42:41.699594 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 06 10:42:41.699594 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 06 10:42:41.699594 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 06 10:42:41.699594 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 06 10:42:41.699594 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 06 10:42:41.699594 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 06 10:42:41.699594 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 06 10:42:41.699594 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f49079c1-1384-4136-b6cf-eadc40fb5aa1 could not be found. Jun 06 10:42:41.699594 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Jun 06 10:42:41.699594 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 10:42:41.699594 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Jun 06 10:42:41.699594 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 10:42:41.699594 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 10:42:41.699594 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 10:42:41.699594 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 10:42:41.699594 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 10:42:41.699594 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 10:42:41.701251 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 10:42:41.701251 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 06 10:42:41.701251 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 06 10:42:41.701251 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 06 10:42:41.701251 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 06 10:42:41.701251 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 06 10:42:41.701251 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 06 10:42:41.701251 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f49079c1-1384-4136-b6cf-eadc40fb5aa1 could not be found. Jun 06 10:42:41.701251 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Jun 06 10:42:41.701251 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 10:42:41.701251 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Jun 06 10:42:41.701251 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 10:42:41.701251 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 10:42:41.701251 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 10:42:41.701251 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 10:42:41.701251 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 10:42:41.701251 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f49079c1-1384-4136-b6cf-eadc40fb5aa1 could not be found. Jun 06 10:42:41.701251 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Jun 06 10:42:41.703033 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-783f73aa-9662-4960-9cf2-d599762080f6 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Returning 404 to user: Instance f49079c1-1384-4136-b6cf-eadc40fb5aa1 could not be found. {{(pid=129349) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 10:42:41.703033 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-783f73aa-9662-4960-9cf2-d599762080f6 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] 10.222.0.42 "GET /compute/v2.1/servers/f49079c1-1384-4136-b6cf-eadc40fb5aa1" status: 404 len: 111 microversion: 2.1 time: 0.037907 Jun 06 10:42:41.703390 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 273/528] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:42:41 2022] GET /compute/v2.1/servers/f49079c1-1384-4136-b6cf-eadc40fb5aa1 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 06 10:42:41.709717 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-cce2572a-d617-44ce-bdc7-4ccc9c6614d8 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Calling method '.version_select at 0x7f8fd80a0160>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:42:41.733756 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-cce2572a-d617-44ce-bdc7-4ccc9c6614d8 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1188802404" status: 202 len: 0 microversion: 2.1 time: 0.029917 Jun 06 10:42:41.734462 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 256/529] 10.222.0.42 () {58 vars in 1220 bytes} [Mon Jun 6 10:42:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1188802404 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 06 10:42:41.996673 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-0ff4ad95-0e3c-4be2-9d0d-2f19a0baff6f tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:42:41.997313 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-0ff4ad95-0e3c-4be2-9d0d-2f19a0baff6f tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] [instance: ce3b66f8-03e9-4d5f-8c40-d1a887b12304] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:42:42.005262 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-0ff4ad95-0e3c-4be2-9d0d-2f19a0baff6f tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:42:42.006098 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-0ff4ad95-0e3c-4be2-9d0d-2f19a0baff6f tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:42:42.007128 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-0ff4ad95-0e3c-4be2-9d0d-2f19a0baff6f tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:42:42.007727 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-0ff4ad95-0e3c-4be2-9d0d-2f19a0baff6f tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:42:42.223923 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-0ff4ad95-0e3c-4be2-9d0d-2f19a0baff6f tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:42:42.232307 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-0ff4ad95-0e3c-4be2-9d0d-2f19a0baff6f tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:42:42.234333 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-0ff4ad95-0e3c-4be2-9d0d-2f19a0baff6f tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:42:42.235608 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-0ff4ad95-0e3c-4be2-9d0d-2f19a0baff6f tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] 10.222.0.42 "GET /compute/v2.1/servers/ce3b66f8-03e9-4d5f-8c40-d1a887b12304" status: 200 len: 1406 microversion: 2.20 time: 0.242855 Jun 06 10:42:42.236420 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 274/530] 10.222.0.42 () {60 vars in 1276 bytes} [Mon Jun 6 10:42:41 2022] GET /compute/v2.1/servers/ce3b66f8-03e9-4d5f-8c40-d1a887b12304 => generated 1406 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 06 10:42:42.258305 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-9e38885d-00ad-4562-840c-fe743721e71b tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:42:42.258924 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-9e38885d-00ad-4562-840c-fe743721e71b tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] [instance: 8e9cb9c1-7df9-4cb7-9121-54bf74f552c7] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:42:42.264870 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-9e38885d-00ad-4562-840c-fe743721e71b tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:42:42.265321 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-9e38885d-00ad-4562-840c-fe743721e71b tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:42:42.266916 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-9e38885d-00ad-4562-840c-fe743721e71b tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:42:42.267357 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-9e38885d-00ad-4562-840c-fe743721e71b tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:42:42.345016 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [req-65db677b-6c3f-42b6-8252-e88ac090b177 req-fc8b594a-2753-4cd8-b171-c7632f0d3f3a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ce3b66f8-03e9-4d5f-8c40-d1a887b12304", "tag": "ff3196f2-cd2c-4cef-8ac8-2d796e5a93a2"}]} {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 10:42:42.353477 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [req-65db677b-6c3f-42b6-8252-e88ac090b177 req-fc8b594a-2753-4cd8-b171-c7632f0d3f3a service nova] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:42:42.353952 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [req-65db677b-6c3f-42b6-8252-e88ac090b177 req-fc8b594a-2753-4cd8-b171-c7632f0d3f3a service nova] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:42:42.370765 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.compute.server_external_events [req-65db677b-6c3f-42b6-8252-e88ac090b177 req-fc8b594a-2753-4cd8-b171-c7632f0d3f3a service nova] Creating event network-changed:ff3196f2-cd2c-4cef-8ac8-2d796e5a93a2 for instance ce3b66f8-03e9-4d5f-8c40-d1a887b12304 on hv-cinder-84482 Jun 06 10:42:42.376265 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [req-65db677b-6c3f-42b6-8252-e88ac090b177 req-fc8b594a-2753-4cd8-b171-c7632f0d3f3a service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034677 Jun 06 10:42:42.377149 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 275/531] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Jun 6 10:42:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 10:42:42.401672 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-ca4b7487-3525-4374-b6b1-b0c778199b92 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Action: 'create', calling method: .version_select at 0x7f8fd373c3a0>, body: {"keypair": {"name": "tempest-keypair-1685981692", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDfFpRea2lQ6mGBpsqitsy+VSG8mlbCB3oJBscKsSLza6HBDdGzGxRHivfDeWBGhrXjQqt54PJEcaLEN86EVL/u7DWwIsGY6WHJUPlgcSoFdhk/Pr9oG/iSNTTloXMLgow=="}} {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 10:42:42.418008 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.quota [None req-ca4b7487-3525-4374-b6b1-b0c778199b92 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Getting quotas for project fe30c756a2f84166ad23af1edf83157e. Resources: {'key_pairs'} {{(pid=129349) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 06 10:42:42.421822 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.quota [None req-ca4b7487-3525-4374-b6b1-b0c778199b92 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Getting quotas for user f6b7d82c999646b6b6b96d565f0e3f9a and project fe30c756a2f84166ad23af1edf83157e. Resources: {'key_pairs'} {{(pid=129349) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 06 10:42:42.433020 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-9e38885d-00ad-4562-840c-fe743721e71b tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7b11ed004fc4ef3a1f1c48adf31fe8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '645eadf589944a24bf6e27326a61952c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:42:42.443105 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-9e38885d-00ad-4562-840c-fe743721e71b tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] 10.222.0.42 "GET /compute/v2.1/servers/8e9cb9c1-7df9-4cb7-9121-54bf74f552c7" status: 200 len: 1756 microversion: 2.1 time: 0.188548 Jun 06 10:42:42.443820 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 257/532] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:42:42 2022] GET /compute/v2.1/servers/8e9cb9c1-7df9-4cb7-9121-54bf74f552c7 => generated 1756 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:42:42.454489 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-ca4b7487-3525-4374-b6b1-b0c778199b92 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.056896 Jun 06 10:42:42.455077 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 276/533] 10.222.0.42 () {60 vars in 1158 bytes} [Mon Jun 6 10:42:42 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 10:42:43.253992 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-22920d7e-e6f0-45a6-9a98-8d5a34c43bc5 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:42:43.254682 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-22920d7e-e6f0-45a6-9a98-8d5a34c43bc5 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] [instance: ce3b66f8-03e9-4d5f-8c40-d1a887b12304] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:42:43.261173 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-22920d7e-e6f0-45a6-9a98-8d5a34c43bc5 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:42:43.261623 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-22920d7e-e6f0-45a6-9a98-8d5a34c43bc5 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:42:43.262399 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-22920d7e-e6f0-45a6-9a98-8d5a34c43bc5 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:42:43.262838 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-22920d7e-e6f0-45a6-9a98-8d5a34c43bc5 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:42:43.461736 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-1de94065-acff-47e4-88a8-f55dde6e1051 tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:42:43.462593 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-1de94065-acff-47e4-88a8-f55dde6e1051 tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] [instance: 8e9cb9c1-7df9-4cb7-9121-54bf74f552c7] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:42:43.468898 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-1de94065-acff-47e4-88a8-f55dde6e1051 tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:42:43.470104 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-1de94065-acff-47e4-88a8-f55dde6e1051 tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:42:43.470952 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-1de94065-acff-47e4-88a8-f55dde6e1051 tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:42:43.471479 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-1de94065-acff-47e4-88a8-f55dde6e1051 tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:42:43.623466 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-22920d7e-e6f0-45a6-9a98-8d5a34c43bc5 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:42:43.632894 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-22920d7e-e6f0-45a6-9a98-8d5a34c43bc5 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:42:43.634532 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-22920d7e-e6f0-45a6-9a98-8d5a34c43bc5 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:42:43.635703 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-22920d7e-e6f0-45a6-9a98-8d5a34c43bc5 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] 10.222.0.42 "GET /compute/v2.1/servers/ce3b66f8-03e9-4d5f-8c40-d1a887b12304" status: 200 len: 1406 microversion: 2.20 time: 0.385759 Jun 06 10:42:43.636362 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 258/534] 10.222.0.42 () {60 vars in 1276 bytes} [Mon Jun 6 10:42:43 2022] GET /compute/v2.1/servers/ce3b66f8-03e9-4d5f-8c40-d1a887b12304 => generated 1406 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 10:42:43.855006 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-1de94065-acff-47e4-88a8-f55dde6e1051 tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7b11ed004fc4ef3a1f1c48adf31fe8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '645eadf589944a24bf6e27326a61952c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:42:43.863867 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-1de94065-acff-47e4-88a8-f55dde6e1051 tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] 10.222.0.42 "GET /compute/v2.1/servers/8e9cb9c1-7df9-4cb7-9121-54bf74f552c7" status: 200 len: 1756 microversion: 2.1 time: 0.406519 Jun 06 10:42:43.864671 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 277/535] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:42:43 2022] GET /compute/v2.1/servers/8e9cb9c1-7df9-4cb7-9121-54bf74f552c7 => generated 1756 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 10:42:44.294827 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-561ceefb-4646-4734-9394-89f0ae63f65b tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-529787263", "imageRef": "6eea2d98-354d-4083-b74c-abcbb97f9e1a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "0fd14970-44c4-4b61-bc49-92cac8d7f904"}], "security_groups": [{"name": "tempest-securitygroup--160625786"}], "key_name": "tempest-keypair-1685981692", "user_data": "}} {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 10:42:44.411552 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.network.neutron [None req-561ceefb-4646-4734-9394-89f0ae63f65b tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] validate_networks() for [('0fd14970-44c4-4b61-bc49-92cac8d7f904', None, None, None, None, None)] {{(pid=129350) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 06 10:42:44.654508 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-ef260389-d427-49af-8d62-f33aa69b2396 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:42:44.655247 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-ef260389-d427-49af-8d62-f33aa69b2396 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] [instance: ce3b66f8-03e9-4d5f-8c40-d1a887b12304] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:42:44.662492 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-ef260389-d427-49af-8d62-f33aa69b2396 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:42:44.662875 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-ef260389-d427-49af-8d62-f33aa69b2396 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:42:44.663645 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-ef260389-d427-49af-8d62-f33aa69b2396 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:42:44.664100 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-ef260389-d427-49af-8d62-f33aa69b2396 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:42:44.837184 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.virt.hardware [None req-561ceefb-4646-4734-9394-89f0ae63f65b tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Flavor limits 0:0:0 {{(pid=129350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 06 10:42:44.837607 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.virt.hardware [None req-561ceefb-4646-4734-9394-89f0ae63f65b tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Image limits 0:0:0 {{(pid=129350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 06 10:42:44.838078 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.virt.hardware [None req-561ceefb-4646-4734-9394-89f0ae63f65b tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Flavor pref 0:0:0 {{(pid=129350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 06 10:42:44.838485 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.virt.hardware [None req-561ceefb-4646-4734-9394-89f0ae63f65b tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Image pref 0:0:0 {{(pid=129350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 06 10:42:44.838900 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.virt.hardware [None req-561ceefb-4646-4734-9394-89f0ae63f65b tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 06 10:42:44.848391 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-561ceefb-4646-4734-9394-89f0ae63f65b tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:42:44.848834 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-561ceefb-4646-4734-9394-89f0ae63f65b tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:42:44.849637 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-561ceefb-4646-4734-9394-89f0ae63f65b tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:42:44.850065 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-561ceefb-4646-4734-9394-89f0ae63f65b tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:42:44.859954 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-ef260389-d427-49af-8d62-f33aa69b2396 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:42:44.866929 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.quota [None req-561ceefb-4646-4734-9394-89f0ae63f65b tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Getting quotas for project fe30c756a2f84166ad23af1edf83157e. Resources: {'ram', 'cores', 'instances'} {{(pid=129350) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 06 10:42:44.867989 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-ef260389-d427-49af-8d62-f33aa69b2396 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:42:44.869489 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-ef260389-d427-49af-8d62-f33aa69b2396 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:42:44.870576 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-ef260389-d427-49af-8d62-f33aa69b2396 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] 10.222.0.42 "GET /compute/v2.1/servers/ce3b66f8-03e9-4d5f-8c40-d1a887b12304" status: 200 len: 1406 microversion: 2.20 time: 0.220015 Jun 06 10:42:44.871038 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.quota [None req-561ceefb-4646-4734-9394-89f0ae63f65b tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Getting quotas for user f6b7d82c999646b6b6b96d565f0e3f9a and project fe30c756a2f84166ad23af1edf83157e. Resources: {'ram', 'cores', 'instances'} {{(pid=129350) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 06 10:42:44.871180 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 278/536] 10.222.0.42 () {60 vars in 1276 bytes} [Mon Jun 6 10:42:44 2022] GET /compute/v2.1/servers/ce3b66f8-03e9-4d5f-8c40-d1a887b12304 => generated 1406 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 06 10:42:44.881198 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-cecc0898-06fa-43ea-9365-0dc5034aabc9 tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:42:44.881809 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-cecc0898-06fa-43ea-9365-0dc5034aabc9 tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] [instance: 8e9cb9c1-7df9-4cb7-9121-54bf74f552c7] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:42:44.883183 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-561ceefb-4646-4734-9394-89f0ae63f65b tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Going to run 1 instances... {{(pid=129350) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 06 10:42:44.885340 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-561ceefb-4646-4734-9394-89f0ae63f65b tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] [instance: bd2981c6-1a22-4f44-9154-170abe988e75] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6eea2d98-354d-4083-b74c-abcbb97f9e1a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129350) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 06 10:42:44.887605 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-cecc0898-06fa-43ea-9365-0dc5034aabc9 tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:42:44.888120 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-cecc0898-06fa-43ea-9365-0dc5034aabc9 tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:42:44.888865 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-cecc0898-06fa-43ea-9365-0dc5034aabc9 tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:42:44.889298 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-cecc0898-06fa-43ea-9365-0dc5034aabc9 tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:42:44.933707 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-561ceefb-4646-4734-9394-89f0ae63f65b tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.643051 Jun 06 10:42:44.934378 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 259/537] 10.222.0.42 () {60 vars in 1146 bytes} [Mon Jun 6 10:42:44 2022] POST /compute/v2.1/servers => generated 401 bytes in 644 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 06 10:42:44.944673 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-a4b8c506-45d1-4711-8ff6-a40684f4b09d tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:42:44.945282 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-a4b8c506-45d1-4711-8ff6-a40684f4b09d tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] [instance: bd2981c6-1a22-4f44-9154-170abe988e75] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:42:45.013639 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-a4b8c506-45d1-4711-8ff6-a40684f4b09d tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b7d82c999646b6b6b96d565f0e3f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe30c756a2f84166ad23af1edf83157e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:42:45.022163 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-a4b8c506-45d1-4711-8ff6-a40684f4b09d tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] 10.222.0.42 "GET /compute/v2.1/servers/bd2981c6-1a22-4f44-9154-170abe988e75" status: 200 len: 1237 microversion: 2.1 time: 0.081121 Jun 06 10:42:45.022732 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 260/538] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:42:44 2022] GET /compute/v2.1/servers/bd2981c6-1a22-4f44-9154-170abe988e75 => generated 1237 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 10:42:45.075132 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-cecc0898-06fa-43ea-9365-0dc5034aabc9 tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7b11ed004fc4ef3a1f1c48adf31fe8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '645eadf589944a24bf6e27326a61952c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:42:45.082909 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-cecc0898-06fa-43ea-9365-0dc5034aabc9 tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] 10.222.0.42 "GET /compute/v2.1/servers/8e9cb9c1-7df9-4cb7-9121-54bf74f552c7" status: 200 len: 1759 microversion: 2.1 time: 0.205397 Jun 06 10:42:45.083729 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 279/539] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:42:44 2022] GET /compute/v2.1/servers/8e9cb9c1-7df9-4cb7-9121-54bf74f552c7 => generated 1759 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:42:45.890947 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-1e3d9782-e124-4e1d-b829-0294ab9e1ffa tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:42:45.891982 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-1e3d9782-e124-4e1d-b829-0294ab9e1ffa tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] [instance: ce3b66f8-03e9-4d5f-8c40-d1a887b12304] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:42:45.899201 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-1e3d9782-e124-4e1d-b829-0294ab9e1ffa tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:42:45.899646 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-1e3d9782-e124-4e1d-b829-0294ab9e1ffa tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:42:45.900449 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-1e3d9782-e124-4e1d-b829-0294ab9e1ffa tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:42:45.900881 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-1e3d9782-e124-4e1d-b829-0294ab9e1ffa tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:42:46.040293 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-9a1673cd-bfae-4cb4-8281-b4b470f6955d tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:42:46.041077 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-9a1673cd-bfae-4cb4-8281-b4b470f6955d tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] [instance: bd2981c6-1a22-4f44-9154-170abe988e75] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:42:46.049408 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-9a1673cd-bfae-4cb4-8281-b4b470f6955d tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:42:46.050099 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-9a1673cd-bfae-4cb4-8281-b4b470f6955d tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:42:46.050897 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-9a1673cd-bfae-4cb4-8281-b4b470f6955d tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:42:46.051514 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-9a1673cd-bfae-4cb4-8281-b4b470f6955d tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:42:46.181277 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-9a1673cd-bfae-4cb4-8281-b4b470f6955d tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b7d82c999646b6b6b96d565f0e3f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe30c756a2f84166ad23af1edf83157e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:42:46.190303 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-9a1673cd-bfae-4cb4-8281-b4b470f6955d tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] 10.222.0.42 "GET /compute/v2.1/servers/bd2981c6-1a22-4f44-9154-170abe988e75" status: 200 len: 1295 microversion: 2.1 time: 0.154006 Jun 06 10:42:46.191048 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 280/540] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:42:46 2022] GET /compute/v2.1/servers/bd2981c6-1a22-4f44-9154-170abe988e75 => generated 1295 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 10:42:46.279423 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-1e3d9782-e124-4e1d-b829-0294ab9e1ffa tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:42:46.288236 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-1e3d9782-e124-4e1d-b829-0294ab9e1ffa tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:42:46.289739 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-1e3d9782-e124-4e1d-b829-0294ab9e1ffa tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:42:46.290831 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-1e3d9782-e124-4e1d-b829-0294ab9e1ffa tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] 10.222.0.42 "GET /compute/v2.1/servers/ce3b66f8-03e9-4d5f-8c40-d1a887b12304" status: 200 len: 1406 microversion: 2.20 time: 0.405332 Jun 06 10:42:46.291409 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 261/541] 10.222.0.42 () {60 vars in 1276 bytes} [Mon Jun 6 10:42:45 2022] GET /compute/v2.1/servers/ce3b66f8-03e9-4d5f-8c40-d1a887b12304 => generated 1406 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 10:42:47.207982 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-8389c72f-de70-4613-b2c5-8456cdcc9af3 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:42:47.208599 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-8389c72f-de70-4613-b2c5-8456cdcc9af3 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] [instance: bd2981c6-1a22-4f44-9154-170abe988e75] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:42:47.214857 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-8389c72f-de70-4613-b2c5-8456cdcc9af3 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:42:47.215303 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-8389c72f-de70-4613-b2c5-8456cdcc9af3 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:42:47.216088 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-8389c72f-de70-4613-b2c5-8456cdcc9af3 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:42:47.216526 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-8389c72f-de70-4613-b2c5-8456cdcc9af3 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:42:47.309518 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-56e1b711-8b82-44c6-a8af-04b7620df707 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:42:47.310358 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-56e1b711-8b82-44c6-a8af-04b7620df707 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] [instance: ce3b66f8-03e9-4d5f-8c40-d1a887b12304] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:42:47.321548 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-56e1b711-8b82-44c6-a8af-04b7620df707 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:42:47.321548 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-56e1b711-8b82-44c6-a8af-04b7620df707 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:42:47.321548 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-56e1b711-8b82-44c6-a8af-04b7620df707 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:42:47.321548 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-56e1b711-8b82-44c6-a8af-04b7620df707 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:42:47.477931 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-8389c72f-de70-4613-b2c5-8456cdcc9af3 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b7d82c999646b6b6b96d565f0e3f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe30c756a2f84166ad23af1edf83157e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:42:47.485926 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-8389c72f-de70-4613-b2c5-8456cdcc9af3 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] 10.222.0.42 "GET /compute/v2.1/servers/bd2981c6-1a22-4f44-9154-170abe988e75" status: 200 len: 1362 microversion: 2.1 time: 0.282188 Jun 06 10:42:47.486906 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 281/542] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:42:47 2022] GET /compute/v2.1/servers/bd2981c6-1a22-4f44-9154-170abe988e75 => generated 1362 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:42:47.585154 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-56e1b711-8b82-44c6-a8af-04b7620df707 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:42:47.594430 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-56e1b711-8b82-44c6-a8af-04b7620df707 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:42:47.596001 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-56e1b711-8b82-44c6-a8af-04b7620df707 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:42:47.597103 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-56e1b711-8b82-44c6-a8af-04b7620df707 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] 10.222.0.42 "GET /compute/v2.1/servers/ce3b66f8-03e9-4d5f-8c40-d1a887b12304" status: 200 len: 1406 microversion: 2.20 time: 0.292610 Jun 06 10:42:47.597695 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 262/543] 10.222.0.42 () {60 vars in 1276 bytes} [Mon Jun 6 10:42:47 2022] GET /compute/v2.1/servers/ce3b66f8-03e9-4d5f-8c40-d1a887b12304 => generated 1406 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 06 10:42:47.718481 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [req-9cdc9612-07cb-4842-af24-458640b84483 req-4eca8cf2-5982-418c-8d2e-769e2614172c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bd2981c6-1a22-4f44-9154-170abe988e75", "tag": "5ef175b9-9b1b-4063-a996-b0636718122b"}]} {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 10:42:47.728368 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [req-9cdc9612-07cb-4842-af24-458640b84483 req-4eca8cf2-5982-418c-8d2e-769e2614172c service nova] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:42:47.728805 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [req-9cdc9612-07cb-4842-af24-458640b84483 req-4eca8cf2-5982-418c-8d2e-769e2614172c service nova] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:42:47.743073 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.compute.server_external_events [req-9cdc9612-07cb-4842-af24-458640b84483 req-4eca8cf2-5982-418c-8d2e-769e2614172c service nova] Creating event network-changed:5ef175b9-9b1b-4063-a996-b0636718122b for instance bd2981c6-1a22-4f44-9154-170abe988e75 on hv-cinder-84482 Jun 06 10:42:47.748123 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [req-9cdc9612-07cb-4842-af24-458640b84483 req-4eca8cf2-5982-418c-8d2e-769e2614172c service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033266 Jun 06 10:42:47.748874 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 282/544] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Jun 6 10:42:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 06 10:42:48.043425 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [req-a1536068-5e60-4826-8f6d-c95eeea34e23 req-7d834fd1-ef86-4652-a82c-fc689719ed78 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce3b66f8-03e9-4d5f-8c40-d1a887b12304", "name": "network-vif-plugged", "status": "completed", "tag": "ff3196f2-cd2c-4cef-8ac8-2d796e5a93a2"}]} {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 10:42:48.054363 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [req-a1536068-5e60-4826-8f6d-c95eeea34e23 req-7d834fd1-ef86-4652-a82c-fc689719ed78 service nova] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:42:48.055258 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [req-a1536068-5e60-4826-8f6d-c95eeea34e23 req-7d834fd1-ef86-4652-a82c-fc689719ed78 service nova] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:42:48.067977 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.compute.server_external_events [req-a1536068-5e60-4826-8f6d-c95eeea34e23 req-7d834fd1-ef86-4652-a82c-fc689719ed78 service nova] Creating event network-vif-plugged:ff3196f2-cd2c-4cef-8ac8-2d796e5a93a2 for instance ce3b66f8-03e9-4d5f-8c40-d1a887b12304 on hv-cinder-84482 Jun 06 10:42:48.074149 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [req-a1536068-5e60-4826-8f6d-c95eeea34e23 req-7d834fd1-ef86-4652-a82c-fc689719ed78 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035701 Jun 06 10:42:48.075104 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 263/545] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Jun 6 10:42:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 10:42:48.504591 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-ce5b5e72-4a44-45cb-8680-0e8dce6874d6 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:42:48.505425 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-ce5b5e72-4a44-45cb-8680-0e8dce6874d6 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] [instance: bd2981c6-1a22-4f44-9154-170abe988e75] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:42:48.512787 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-ce5b5e72-4a44-45cb-8680-0e8dce6874d6 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:42:48.513460 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-ce5b5e72-4a44-45cb-8680-0e8dce6874d6 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:42:48.514512 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-ce5b5e72-4a44-45cb-8680-0e8dce6874d6 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:42:48.514997 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-ce5b5e72-4a44-45cb-8680-0e8dce6874d6 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:42:48.615397 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-5b32741f-aa6b-4a7f-85c5-d4c7cdb197a0 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:42:48.616141 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-5b32741f-aa6b-4a7f-85c5-d4c7cdb197a0 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] [instance: ce3b66f8-03e9-4d5f-8c40-d1a887b12304] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:42:48.622755 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-5b32741f-aa6b-4a7f-85c5-d4c7cdb197a0 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:42:48.623197 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-5b32741f-aa6b-4a7f-85c5-d4c7cdb197a0 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:42:48.623983 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-5b32741f-aa6b-4a7f-85c5-d4c7cdb197a0 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:42:48.624412 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-5b32741f-aa6b-4a7f-85c5-d4c7cdb197a0 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:42:48.651538 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-ce5b5e72-4a44-45cb-8680-0e8dce6874d6 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b7d82c999646b6b6b96d565f0e3f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe30c756a2f84166ad23af1edf83157e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:42:48.659644 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-ce5b5e72-4a44-45cb-8680-0e8dce6874d6 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] 10.222.0.42 "GET /compute/v2.1/servers/bd2981c6-1a22-4f44-9154-170abe988e75" status: 200 len: 1362 microversion: 2.1 time: 0.160695 Jun 06 10:42:48.660667 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 283/546] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:42:48 2022] GET /compute/v2.1/servers/bd2981c6-1a22-4f44-9154-170abe988e75 => generated 1362 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:42:48.755641 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-5b32741f-aa6b-4a7f-85c5-d4c7cdb197a0 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:42:48.763516 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-5b32741f-aa6b-4a7f-85c5-d4c7cdb197a0 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:42:48.765074 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-5b32741f-aa6b-4a7f-85c5-d4c7cdb197a0 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:42:48.766718 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-5b32741f-aa6b-4a7f-85c5-d4c7cdb197a0 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] 10.222.0.42 "GET /compute/v2.1/servers/ce3b66f8-03e9-4d5f-8c40-d1a887b12304" status: 200 len: 1406 microversion: 2.20 time: 0.155186 Jun 06 10:42:48.767276 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 264/547] 10.222.0.42 () {60 vars in 1276 bytes} [Mon Jun 6 10:42:48 2022] GET /compute/v2.1/servers/ce3b66f8-03e9-4d5f-8c40-d1a887b12304 => generated 1406 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 06 10:42:49.676438 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-05d01d28-5484-4612-98a2-1d5d1828d29f tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:42:49.677055 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-05d01d28-5484-4612-98a2-1d5d1828d29f tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] [instance: bd2981c6-1a22-4f44-9154-170abe988e75] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:42:49.683607 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-05d01d28-5484-4612-98a2-1d5d1828d29f tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:42:49.684082 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-05d01d28-5484-4612-98a2-1d5d1828d29f tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:42:49.684848 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-05d01d28-5484-4612-98a2-1d5d1828d29f tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:42:49.685282 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-05d01d28-5484-4612-98a2-1d5d1828d29f tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:42:49.784251 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-fcca69ee-3e34-42e9-8f0d-00fe753ac6c0 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:42:49.784867 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-fcca69ee-3e34-42e9-8f0d-00fe753ac6c0 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] [instance: ce3b66f8-03e9-4d5f-8c40-d1a887b12304] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:42:49.791260 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-fcca69ee-3e34-42e9-8f0d-00fe753ac6c0 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:42:49.791708 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-fcca69ee-3e34-42e9-8f0d-00fe753ac6c0 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:42:49.792501 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-fcca69ee-3e34-42e9-8f0d-00fe753ac6c0 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:42:49.792942 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-fcca69ee-3e34-42e9-8f0d-00fe753ac6c0 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:42:49.817989 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-05d01d28-5484-4612-98a2-1d5d1828d29f tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b7d82c999646b6b6b96d565f0e3f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe30c756a2f84166ad23af1edf83157e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:42:49.825324 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-05d01d28-5484-4612-98a2-1d5d1828d29f tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] 10.222.0.42 "GET /compute/v2.1/servers/bd2981c6-1a22-4f44-9154-170abe988e75" status: 200 len: 1362 microversion: 2.1 time: 0.152751 Jun 06 10:42:49.825885 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 284/548] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:42:49 2022] GET /compute/v2.1/servers/bd2981c6-1a22-4f44-9154-170abe988e75 => generated 1362 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:42:49.920181 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-fcca69ee-3e34-42e9-8f0d-00fe753ac6c0 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:42:49.928804 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-fcca69ee-3e34-42e9-8f0d-00fe753ac6c0 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:42:49.930617 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-fcca69ee-3e34-42e9-8f0d-00fe753ac6c0 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:42:49.931703 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-fcca69ee-3e34-42e9-8f0d-00fe753ac6c0 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] 10.222.0.42 "GET /compute/v2.1/servers/ce3b66f8-03e9-4d5f-8c40-d1a887b12304" status: 200 len: 1406 microversion: 2.20 time: 0.151290 Jun 06 10:42:49.932536 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 265/549] 10.222.0.42 () {60 vars in 1276 bytes} [Mon Jun 6 10:42:49 2022] GET /compute/v2.1/servers/ce3b66f8-03e9-4d5f-8c40-d1a887b12304 => generated 1406 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 06 10:42:50.842361 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-e36030d8-8e29-4e22-8a7b-ef6152959e4b tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:42:50.843074 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-e36030d8-8e29-4e22-8a7b-ef6152959e4b tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] [instance: bd2981c6-1a22-4f44-9154-170abe988e75] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:42:50.850413 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-e36030d8-8e29-4e22-8a7b-ef6152959e4b tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:42:50.850845 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-e36030d8-8e29-4e22-8a7b-ef6152959e4b tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:42:50.851689 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-e36030d8-8e29-4e22-8a7b-ef6152959e4b tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:42:50.852148 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-e36030d8-8e29-4e22-8a7b-ef6152959e4b tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:42:50.950688 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-d262ac6b-ce6f-4925-b925-19db671326ab tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:42:50.951326 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-d262ac6b-ce6f-4925-b925-19db671326ab tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] [instance: ce3b66f8-03e9-4d5f-8c40-d1a887b12304] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:42:50.958329 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-d262ac6b-ce6f-4925-b925-19db671326ab tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:42:50.958771 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-d262ac6b-ce6f-4925-b925-19db671326ab tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:42:50.959537 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-d262ac6b-ce6f-4925-b925-19db671326ab tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:42:50.959997 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-d262ac6b-ce6f-4925-b925-19db671326ab tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:42:50.964037 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG dbcounter [-] [129350] Writing DB stats nova_cell1:SELECT=100 {{(pid=129350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 10:42:50.994067 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-e36030d8-8e29-4e22-8a7b-ef6152959e4b tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b7d82c999646b6b6b96d565f0e3f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe30c756a2f84166ad23af1edf83157e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:42:51.004070 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-e36030d8-8e29-4e22-8a7b-ef6152959e4b tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] 10.222.0.42 "GET /compute/v2.1/servers/bd2981c6-1a22-4f44-9154-170abe988e75" status: 200 len: 1362 microversion: 2.1 time: 0.165445 Jun 06 10:42:51.005394 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 285/550] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:42:50 2022] GET /compute/v2.1/servers/bd2981c6-1a22-4f44-9154-170abe988e75 => generated 1362 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:42:51.095736 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-d262ac6b-ce6f-4925-b925-19db671326ab tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:42:51.103816 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-d262ac6b-ce6f-4925-b925-19db671326ab tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:42:51.105343 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-d262ac6b-ce6f-4925-b925-19db671326ab tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:42:51.106478 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-d262ac6b-ce6f-4925-b925-19db671326ab tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] 10.222.0.42 "GET /compute/v2.1/servers/ce3b66f8-03e9-4d5f-8c40-d1a887b12304" status: 200 len: 1597 microversion: 2.20 time: 0.159820 Jun 06 10:42:51.107031 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 266/551] 10.222.0.42 () {60 vars in 1276 bytes} [Mon Jun 6 10:42:50 2022] GET /compute/v2.1/servers/ce3b66f8-03e9-4d5f-8c40-d1a887b12304 => generated 1597 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 06 10:42:51.123835 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-8827dcfd-c1e4-4871-9ed3-1b30c5a242b7 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:42:51.124330 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-8827dcfd-c1e4-4871-9ed3-1b30c5a242b7 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] [instance: ce3b66f8-03e9-4d5f-8c40-d1a887b12304] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:42:51.131030 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-8827dcfd-c1e4-4871-9ed3-1b30c5a242b7 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:42:51.131476 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-8827dcfd-c1e4-4871-9ed3-1b30c5a242b7 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:42:51.132307 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-8827dcfd-c1e4-4871-9ed3-1b30c5a242b7 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:42:51.132744 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-8827dcfd-c1e4-4871-9ed3-1b30c5a242b7 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:42:51.215839 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-8827dcfd-c1e4-4871-9ed3-1b30c5a242b7 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] 10.222.0.42 "GET /compute/v2.1/servers/ce3b66f8-03e9-4d5f-8c40-d1a887b12304/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.095776 Jun 06 10:42:51.216439 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 286/552] 10.222.0.42 () {60 vars in 1315 bytes} [Mon Jun 6 10:42:51 2022] GET /compute/v2.1/servers/ce3b66f8-03e9-4d5f-8c40-d1a887b12304/os-interface => generated 284 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 06 10:42:52.022713 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-5d1b0521-980b-4127-a4df-812dec802043 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:42:52.023338 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-5d1b0521-980b-4127-a4df-812dec802043 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] [instance: bd2981c6-1a22-4f44-9154-170abe988e75] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:42:52.030560 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-5d1b0521-980b-4127-a4df-812dec802043 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:42:52.031065 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-5d1b0521-980b-4127-a4df-812dec802043 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:42:52.033268 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-5d1b0521-980b-4127-a4df-812dec802043 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:42:52.033879 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-5d1b0521-980b-4127-a4df-812dec802043 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:42:52.352827 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-5d1b0521-980b-4127-a4df-812dec802043 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b7d82c999646b6b6b96d565f0e3f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe30c756a2f84166ad23af1edf83157e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:42:52.360565 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-5d1b0521-980b-4127-a4df-812dec802043 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] 10.222.0.42 "GET /compute/v2.1/servers/bd2981c6-1a22-4f44-9154-170abe988e75" status: 200 len: 1362 microversion: 2.1 time: 0.341787 Jun 06 10:42:52.361338 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 267/553] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:42:52 2022] GET /compute/v2.1/servers/bd2981c6-1a22-4f44-9154-170abe988e75 => generated 1362 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:42:52.451926 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG dbcounter [-] [129349] Writing DB stats nova_cell0:SELECT=8 {{(pid=129349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 10:42:52.456566 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [req-a1c7a2c9-d10d-4816-9a08-3b8861766019 req-c79275d1-edb4-47dc-a330-626670775fdf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ce3b66f8-03e9-4d5f-8c40-d1a887b12304", "tag": "ff3196f2-cd2c-4cef-8ac8-2d796e5a93a2"}]} {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 10:42:52.464916 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [req-a1c7a2c9-d10d-4816-9a08-3b8861766019 req-c79275d1-edb4-47dc-a330-626670775fdf service nova] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:42:52.465357 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [req-a1c7a2c9-d10d-4816-9a08-3b8861766019 req-c79275d1-edb4-47dc-a330-626670775fdf service nova] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:42:52.476529 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.compute.server_external_events [req-a1c7a2c9-d10d-4816-9a08-3b8861766019 req-c79275d1-edb4-47dc-a330-626670775fdf service nova] Creating event network-changed:ff3196f2-cd2c-4cef-8ac8-2d796e5a93a2 for instance ce3b66f8-03e9-4d5f-8c40-d1a887b12304 on hv-cinder-84482 Jun 06 10:42:52.481266 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [req-a1c7a2c9-d10d-4816-9a08-3b8861766019 req-c79275d1-edb4-47dc-a330-626670775fdf service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030575 Jun 06 10:42:52.481847 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 287/554] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Jun 6 10:42:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 10:42:53.378097 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-e768f367-ac11-4228-9fef-cd9c00d3cb30 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:42:53.378764 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-e768f367-ac11-4228-9fef-cd9c00d3cb30 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] [instance: bd2981c6-1a22-4f44-9154-170abe988e75] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:42:53.385808 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-e768f367-ac11-4228-9fef-cd9c00d3cb30 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:42:53.386255 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-e768f367-ac11-4228-9fef-cd9c00d3cb30 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:42:53.387230 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-e768f367-ac11-4228-9fef-cd9c00d3cb30 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:42:53.387678 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-e768f367-ac11-4228-9fef-cd9c00d3cb30 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:42:53.519975 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-e768f367-ac11-4228-9fef-cd9c00d3cb30 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b7d82c999646b6b6b96d565f0e3f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe30c756a2f84166ad23af1edf83157e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:42:53.527379 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-e768f367-ac11-4228-9fef-cd9c00d3cb30 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] 10.222.0.42 "GET /compute/v2.1/servers/bd2981c6-1a22-4f44-9154-170abe988e75" status: 200 len: 1362 microversion: 2.1 time: 0.153302 Jun 06 10:42:53.527966 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 268/555] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:42:53 2022] GET /compute/v2.1/servers/bd2981c6-1a22-4f44-9154-170abe988e75 => generated 1362 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:42:54.157236 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [req-dff5b108-2585-40a4-8b5e-4b8900a5b847 req-21061ceb-23ea-4d92-ab6d-0c8f813ebc99 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd2981c6-1a22-4f44-9154-170abe988e75", "name": "network-vif-plugged", "status": "completed", "tag": "5ef175b9-9b1b-4063-a996-b0636718122b"}]} {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 10:42:54.166114 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [req-dff5b108-2585-40a4-8b5e-4b8900a5b847 req-21061ceb-23ea-4d92-ab6d-0c8f813ebc99 service nova] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:42:54.166626 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [req-dff5b108-2585-40a4-8b5e-4b8900a5b847 req-21061ceb-23ea-4d92-ab6d-0c8f813ebc99 service nova] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:42:54.177781 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.compute.server_external_events [req-dff5b108-2585-40a4-8b5e-4b8900a5b847 req-21061ceb-23ea-4d92-ab6d-0c8f813ebc99 service nova] Creating event network-vif-plugged:5ef175b9-9b1b-4063-a996-b0636718122b for instance bd2981c6-1a22-4f44-9154-170abe988e75 on hv-cinder-84482 Jun 06 10:42:54.182950 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [req-dff5b108-2585-40a4-8b5e-4b8900a5b847 req-21061ceb-23ea-4d92-ab6d-0c8f813ebc99 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030175 Jun 06 10:42:54.183535 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 288/556] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Jun 6 10:42:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 10:42:54.544824 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-75861a15-30a7-4206-af32-38a5a018687b tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:42:54.545444 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-75861a15-30a7-4206-af32-38a5a018687b tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] [instance: bd2981c6-1a22-4f44-9154-170abe988e75] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:42:54.552544 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-75861a15-30a7-4206-af32-38a5a018687b tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:42:54.552997 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-75861a15-30a7-4206-af32-38a5a018687b tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:42:54.553794 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-75861a15-30a7-4206-af32-38a5a018687b tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:42:54.554233 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-75861a15-30a7-4206-af32-38a5a018687b tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:42:54.684681 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-75861a15-30a7-4206-af32-38a5a018687b tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b7d82c999646b6b6b96d565f0e3f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe30c756a2f84166ad23af1edf83157e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:42:54.692642 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-75861a15-30a7-4206-af32-38a5a018687b tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] 10.222.0.42 "GET /compute/v2.1/servers/bd2981c6-1a22-4f44-9154-170abe988e75" status: 200 len: 1362 microversion: 2.1 time: 0.151682 Jun 06 10:42:54.693211 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 269/557] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:42:54 2022] GET /compute/v2.1/servers/bd2981c6-1a22-4f44-9154-170abe988e75 => generated 1362 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 10:42:55.710368 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-fc862111-89f9-4f9f-9420-3e65a47b1f9c tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:42:55.711074 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-fc862111-89f9-4f9f-9420-3e65a47b1f9c tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] [instance: bd2981c6-1a22-4f44-9154-170abe988e75] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:42:55.717797 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-fc862111-89f9-4f9f-9420-3e65a47b1f9c tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:42:55.718726 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-fc862111-89f9-4f9f-9420-3e65a47b1f9c tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:42:55.719659 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-fc862111-89f9-4f9f-9420-3e65a47b1f9c tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:42:55.720122 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-fc862111-89f9-4f9f-9420-3e65a47b1f9c tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:42:55.849111 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-fc862111-89f9-4f9f-9420-3e65a47b1f9c tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b7d82c999646b6b6b96d565f0e3f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe30c756a2f84166ad23af1edf83157e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:42:55.857083 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-fc862111-89f9-4f9f-9420-3e65a47b1f9c tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] 10.222.0.42 "GET /compute/v2.1/servers/bd2981c6-1a22-4f44-9154-170abe988e75" status: 200 len: 1548 microversion: 2.1 time: 0.150956 Jun 06 10:42:55.857653 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 289/558] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:42:55 2022] GET /compute/v2.1/servers/bd2981c6-1a22-4f44-9154-170abe988e75 => generated 1548 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:42:55.874148 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-baa35f41-92d6-4731-8a98-43632caabb85 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:42:55.875247 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-baa35f41-92d6-4731-8a98-43632caabb85 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] [instance: bd2981c6-1a22-4f44-9154-170abe988e75] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:42:55.877420 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG dbcounter [-] [129350] Writing DB stats nova_cell0:SELECT=4 {{(pid=129350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 10:42:55.878093 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG dbcounter [-] [129350] Writing DB stats nova_cell0:SELECT=16 {{(pid=129350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 10:42:55.884769 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-baa35f41-92d6-4731-8a98-43632caabb85 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:42:55.885220 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-baa35f41-92d6-4731-8a98-43632caabb85 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:42:55.885979 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-baa35f41-92d6-4731-8a98-43632caabb85 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:42:55.886416 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-baa35f41-92d6-4731-8a98-43632caabb85 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:42:55.967472 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-baa35f41-92d6-4731-8a98-43632caabb85 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] 10.222.0.42 "GET /compute/v2.1/servers/bd2981c6-1a22-4f44-9154-170abe988e75/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.097151 Jun 06 10:42:55.968103 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 270/559] 10.222.0.42 () {58 vars in 1274 bytes} [Mon Jun 6 10:42:55 2022] GET /compute/v2.1/servers/bd2981c6-1a22-4f44-9154-170abe988e75/os-interface => generated 285 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 06 10:42:57.075210 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [req-8d33d946-45cb-45db-b40a-6c4c74644db5 req-944df577-721e-4080-a2a5-d1c0b4bf1c5c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bd2981c6-1a22-4f44-9154-170abe988e75", "tag": "5ef175b9-9b1b-4063-a996-b0636718122b"}]} {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 10:42:57.083840 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [req-8d33d946-45cb-45db-b40a-6c4c74644db5 req-944df577-721e-4080-a2a5-d1c0b4bf1c5c service nova] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:42:57.084466 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [req-8d33d946-45cb-45db-b40a-6c4c74644db5 req-944df577-721e-4080-a2a5-d1c0b4bf1c5c service nova] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:42:57.096051 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.compute.server_external_events [req-8d33d946-45cb-45db-b40a-6c4c74644db5 req-944df577-721e-4080-a2a5-d1c0b4bf1c5c service nova] Creating event network-changed:5ef175b9-9b1b-4063-a996-b0636718122b for instance bd2981c6-1a22-4f44-9154-170abe988e75 on hv-cinder-84482 Jun 06 10:42:57.101055 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [req-8d33d946-45cb-45db-b40a-6c4c74644db5 req-944df577-721e-4080-a2a5-d1c0b4bf1c5c service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029619 Jun 06 10:42:57.101800 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 290/560] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Jun 6 10:42:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 10:42:57.943173 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-0dda2161-025f-4579-ba1b-d9b08beeb449 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:42:57.943693 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-0dda2161-025f-4579-ba1b-d9b08beeb449 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] [instance: d4d7ae82-4a52-4e0e-87b5-13a5b95cc3a0] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:42:57.950176 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-0dda2161-025f-4579-ba1b-d9b08beeb449 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:42:57.950624 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-0dda2161-025f-4579-ba1b-d9b08beeb449 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:42:57.951406 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-0dda2161-025f-4579-ba1b-d9b08beeb449 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:42:57.951864 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-0dda2161-025f-4579-ba1b-d9b08beeb449 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:42:58.030920 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.objects.instance [None req-0dda2161-025f-4579-ba1b-d9b08beeb449 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lazy-loading 'services' on Instance uuid d4d7ae82-4a52-4e0e-87b5-13a5b95cc3a0 {{(pid=129350) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 06 10:42:58.103940 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-0dda2161-025f-4579-ba1b-d9b08beeb449 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] 10.222.0.42 "DELETE /compute/v2.1/servers/d4d7ae82-4a52-4e0e-87b5-13a5b95cc3a0/os-volume_attachments/a552af91-4f0b-475b-bfbb-1078f971dd78" status: 202 len: 0 microversion: 2.1 time: 0.164999 Jun 06 10:42:58.104825 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 271/561] 10.222.0.42 () {58 vars in 1415 bytes} [Mon Jun 6 10:42:57 2022] DELETE /compute/v2.1/servers/d4d7ae82-4a52-4e0e-87b5-13a5b95cc3a0/os-volume_attachments/a552af91-4f0b-475b-bfbb-1078f971dd78 => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 06 10:42:58.115583 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-1d44b403-c325-4282-ae3f-f8be70a7eff7 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:42:58.116644 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-1d44b403-c325-4282-ae3f-f8be70a7eff7 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] [instance: d4d7ae82-4a52-4e0e-87b5-13a5b95cc3a0] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:42:58.123282 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-1d44b403-c325-4282-ae3f-f8be70a7eff7 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:42:58.123743 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-1d44b403-c325-4282-ae3f-f8be70a7eff7 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:42:58.125215 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-1d44b403-c325-4282-ae3f-f8be70a7eff7 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:42:58.125655 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-1d44b403-c325-4282-ae3f-f8be70a7eff7 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:42:58.156233 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-1d44b403-c325-4282-ae3f-f8be70a7eff7 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] 10.222.0.42 "GET /compute/v2.1/servers/d4d7ae82-4a52-4e0e-87b5-13a5b95cc3a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045736 Jun 06 10:42:58.156979 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 291/562] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jun 6 10:42:58 2022] GET /compute/v2.1/servers/d4d7ae82-4a52-4e0e-87b5-13a5b95cc3a0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 10:42:59.168609 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-90c3ba4f-b8d8-4cc9-81fd-135295674e3b tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:42:59.169726 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-90c3ba4f-b8d8-4cc9-81fd-135295674e3b tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] [instance: d4d7ae82-4a52-4e0e-87b5-13a5b95cc3a0] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:42:59.176248 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-90c3ba4f-b8d8-4cc9-81fd-135295674e3b tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:42:59.176697 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-90c3ba4f-b8d8-4cc9-81fd-135295674e3b tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:42:59.177463 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-90c3ba4f-b8d8-4cc9-81fd-135295674e3b tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:42:59.177895 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-90c3ba4f-b8d8-4cc9-81fd-135295674e3b tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:42:59.207496 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-90c3ba4f-b8d8-4cc9-81fd-135295674e3b tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] 10.222.0.42 "GET /compute/v2.1/servers/d4d7ae82-4a52-4e0e-87b5-13a5b95cc3a0/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043455 Jun 06 10:42:59.208343 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 272/563] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jun 6 10:42:59 2022] GET /compute/v2.1/servers/d4d7ae82-4a52-4e0e-87b5-13a5b95cc3a0/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 06 10:42:59.286262 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-d57eefb2-606d-41df-9325-1004d5dd2542 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:42:59.286796 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-d57eefb2-606d-41df-9325-1004d5dd2542 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] [instance: d4d7ae82-4a52-4e0e-87b5-13a5b95cc3a0] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:42:59.293288 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-d57eefb2-606d-41df-9325-1004d5dd2542 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:42:59.293740 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-d57eefb2-606d-41df-9325-1004d5dd2542 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:42:59.294502 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-d57eefb2-606d-41df-9325-1004d5dd2542 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:42:59.294938 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-d57eefb2-606d-41df-9325-1004d5dd2542 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:42:59.320693 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-d57eefb2-606d-41df-9325-1004d5dd2542 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] [instance: d4d7ae82-4a52-4e0e-87b5-13a5b95cc3a0] Going to try to terminate instance {{(pid=129349) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 06 10:42:59.346985 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG dbcounter [-] [129349] Writing DB stats nova_cell1:SELECT=100 {{(pid=129349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 10:42:59.394403 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-d57eefb2-606d-41df-9325-1004d5dd2542 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] 10.222.0.42 "DELETE /compute/v2.1/servers/d4d7ae82-4a52-4e0e-87b5-13a5b95cc3a0" status: 204 len: 0 microversion: 2.1 time: 0.111734 Jun 06 10:42:59.394988 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 292/564] 10.222.0.42 () {58 vars in 1238 bytes} [Mon Jun 6 10:42:59 2022] DELETE /compute/v2.1/servers/d4d7ae82-4a52-4e0e-87b5-13a5b95cc3a0 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 06 10:42:59.403481 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-17cd6aa6-3f64-406a-8434-980ff602f68d tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:42:59.404238 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-17cd6aa6-3f64-406a-8434-980ff602f68d tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] [instance: d4d7ae82-4a52-4e0e-87b5-13a5b95cc3a0] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:42:59.411551 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-17cd6aa6-3f64-406a-8434-980ff602f68d tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:42:59.412118 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-17cd6aa6-3f64-406a-8434-980ff602f68d tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:42:59.412994 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-17cd6aa6-3f64-406a-8434-980ff602f68d tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:42:59.413447 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-17cd6aa6-3f64-406a-8434-980ff602f68d tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:42:59.552283 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-17cd6aa6-3f64-406a-8434-980ff602f68d tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f269e146c844480c822347c3a38d103b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2b17b61b73b4e6d81dd8ffe9cf311ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:42:59.559804 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-17cd6aa6-3f64-406a-8434-980ff602f68d tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] 10.222.0.42 "GET /compute/v2.1/servers/d4d7ae82-4a52-4e0e-87b5-13a5b95cc3a0" status: 200 len: 1688 microversion: 2.1 time: 0.160388 Jun 06 10:42:59.560361 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 273/565] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:42:59 2022] GET /compute/v2.1/servers/d4d7ae82-4a52-4e0e-87b5-13a5b95cc3a0 => generated 1688 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:43:00.578970 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-3e2eb309-d40d-4976-a1ff-24063e86e301 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:43:00.579661 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-3e2eb309-d40d-4976-a1ff-24063e86e301 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] [instance: d4d7ae82-4a52-4e0e-87b5-13a5b95cc3a0] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:43:00.586119 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-3e2eb309-d40d-4976-a1ff-24063e86e301 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:43:00.586558 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-3e2eb309-d40d-4976-a1ff-24063e86e301 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:43:00.587317 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-3e2eb309-d40d-4976-a1ff-24063e86e301 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:43:00.587741 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-3e2eb309-d40d-4976-a1ff-24063e86e301 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:43:00.719432 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-3e2eb309-d40d-4976-a1ff-24063e86e301 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f269e146c844480c822347c3a38d103b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2b17b61b73b4e6d81dd8ffe9cf311ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:43:00.726851 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-3e2eb309-d40d-4976-a1ff-24063e86e301 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] 10.222.0.42 "GET /compute/v2.1/servers/d4d7ae82-4a52-4e0e-87b5-13a5b95cc3a0" status: 200 len: 1688 microversion: 2.1 time: 0.152688 Jun 06 10:43:00.727401 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 293/566] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:43:00 2022] GET /compute/v2.1/servers/d4d7ae82-4a52-4e0e-87b5-13a5b95cc3a0 => generated 1688 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:43:01.743929 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-680bb5e7-67ad-4648-9f7f-caf44a303a1a tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:43:01.744549 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-680bb5e7-67ad-4648-9f7f-caf44a303a1a tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] [instance: d4d7ae82-4a52-4e0e-87b5-13a5b95cc3a0] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:43:01.751319 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-680bb5e7-67ad-4648-9f7f-caf44a303a1a tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:43:01.751923 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-680bb5e7-67ad-4648-9f7f-caf44a303a1a tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:43:01.752732 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-680bb5e7-67ad-4648-9f7f-caf44a303a1a tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:43:01.753164 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-680bb5e7-67ad-4648-9f7f-caf44a303a1a tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:43:01.883576 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-680bb5e7-67ad-4648-9f7f-caf44a303a1a tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f269e146c844480c822347c3a38d103b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2b17b61b73b4e6d81dd8ffe9cf311ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:43:01.891829 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-680bb5e7-67ad-4648-9f7f-caf44a303a1a tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] 10.222.0.42 "GET /compute/v2.1/servers/d4d7ae82-4a52-4e0e-87b5-13a5b95cc3a0" status: 200 len: 1688 microversion: 2.1 time: 0.151772 Jun 06 10:43:01.892392 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 274/567] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:43:01 2022] GET /compute/v2.1/servers/d4d7ae82-4a52-4e0e-87b5-13a5b95cc3a0 => generated 1688 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:43:02.909549 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-3aab2d79-80e2-4a35-9e34-d3d1e189948a tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:43:02.910181 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-3aab2d79-80e2-4a35-9e34-d3d1e189948a tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] [instance: d4d7ae82-4a52-4e0e-87b5-13a5b95cc3a0] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:43:02.916802 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-3aab2d79-80e2-4a35-9e34-d3d1e189948a tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:43:02.917230 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-3aab2d79-80e2-4a35-9e34-d3d1e189948a tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:43:02.917996 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-3aab2d79-80e2-4a35-9e34-d3d1e189948a tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:43:02.918436 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-3aab2d79-80e2-4a35-9e34-d3d1e189948a tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:43:03.065386 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-3aab2d79-80e2-4a35-9e34-d3d1e189948a tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f269e146c844480c822347c3a38d103b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2b17b61b73b4e6d81dd8ffe9cf311ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:43:03.073169 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-3aab2d79-80e2-4a35-9e34-d3d1e189948a tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] 10.222.0.42 "GET /compute/v2.1/servers/d4d7ae82-4a52-4e0e-87b5-13a5b95cc3a0" status: 200 len: 1688 microversion: 2.1 time: 0.168126 Jun 06 10:43:03.074035 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 294/568] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:43:02 2022] GET /compute/v2.1/servers/d4d7ae82-4a52-4e0e-87b5-13a5b95cc3a0 => generated 1688 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:43:03.886744 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [req-ea88d5e5-1233-46a3-8031-9a371c659137 req-73c00f02-b82c-44bd-9e00-3522aeb2efc4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4d7ae82-4a52-4e0e-87b5-13a5b95cc3a0", "name": "network-vif-deleted", "tag": "c4ec0cb9-f04f-437e-bf0f-93e81d012b38"}]} {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 10:43:03.897056 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [req-ea88d5e5-1233-46a3-8031-9a371c659137 req-73c00f02-b82c-44bd-9e00-3522aeb2efc4 service nova] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:43:03.897420 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [req-ea88d5e5-1233-46a3-8031-9a371c659137 req-73c00f02-b82c-44bd-9e00-3522aeb2efc4 service nova] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:43:03.909675 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.compute.server_external_events [req-ea88d5e5-1233-46a3-8031-9a371c659137 req-73c00f02-b82c-44bd-9e00-3522aeb2efc4 service nova] Creating event network-vif-deleted:c4ec0cb9-f04f-437e-bf0f-93e81d012b38 for instance d4d7ae82-4a52-4e0e-87b5-13a5b95cc3a0 on hv-cinder-84482 Jun 06 10:43:03.915146 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [req-ea88d5e5-1233-46a3-8031-9a371c659137 req-73c00f02-b82c-44bd-9e00-3522aeb2efc4 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031953 Jun 06 10:43:03.916091 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 275/569] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Jun 6 10:43:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 10:43:04.090726 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-098f4aaa-4118-4e91-917b-8f3952dd6851 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:43:04.093650 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-098f4aaa-4118-4e91-917b-8f3952dd6851 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] [instance: d4d7ae82-4a52-4e0e-87b5-13a5b95cc3a0] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:43:04.100637 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-098f4aaa-4118-4e91-917b-8f3952dd6851 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:43:04.101328 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-098f4aaa-4118-4e91-917b-8f3952dd6851 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:43:04.102106 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-098f4aaa-4118-4e91-917b-8f3952dd6851 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:43:04.102536 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-098f4aaa-4118-4e91-917b-8f3952dd6851 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:43:04.137126 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-098f4aaa-4118-4e91-917b-8f3952dd6851 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:43:04.137577 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-098f4aaa-4118-4e91-917b-8f3952dd6851 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:43:04.138023 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.objects.instance [None req-098f4aaa-4118-4e91-917b-8f3952dd6851 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lazy-loading 'fault' on Instance uuid d4d7ae82-4a52-4e0e-87b5-13a5b95cc3a0 {{(pid=129349) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 06 10:43:04.235063 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-098f4aaa-4118-4e91-917b-8f3952dd6851 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f269e146c844480c822347c3a38d103b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2b17b61b73b4e6d81dd8ffe9cf311ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:43:04.242670 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-098f4aaa-4118-4e91-917b-8f3952dd6851 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] 10.222.0.42 "GET /compute/v2.1/servers/d4d7ae82-4a52-4e0e-87b5-13a5b95cc3a0" status: 200 len: 1334 microversion: 2.1 time: 0.155831 Jun 06 10:43:04.243326 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 295/570] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:43:04 2022] GET /compute/v2.1/servers/d4d7ae82-4a52-4e0e-87b5-13a5b95cc3a0 => generated 1334 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:43:05.261389 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-f527f4aa-9093-4912-b486-a564afe00c59 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:43:05.262086 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-f527f4aa-9093-4912-b486-a564afe00c59 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] [instance: d4d7ae82-4a52-4e0e-87b5-13a5b95cc3a0] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:43:05.269597 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-f527f4aa-9093-4912-b486-a564afe00c59 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:43:05.270042 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-f527f4aa-9093-4912-b486-a564afe00c59 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:43:05.270802 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-f527f4aa-9093-4912-b486-a564afe00c59 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:43:05.271235 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-f527f4aa-9093-4912-b486-a564afe00c59 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:43:05.284113 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.wsgi [None req-f527f4aa-9093-4912-b486-a564afe00c59 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] HTTP exception thrown: Instance d4d7ae82-4a52-4e0e-87b5-13a5b95cc3a0 could not be found. Jun 06 10:43:05.285699 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-f527f4aa-9093-4912-b486-a564afe00c59 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Request method failure captured: Jun 06 10:43:05.285699 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: request: GET /compute/v2.1/servers/d4d7ae82-4a52-4e0e-87b5-13a5b95cc3a0 HTTP/1.1 Jun 06 10:43:05.285699 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: Accept: application/json Jun 06 10:43:05.285699 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: Accept-Encoding: identity Jun 06 10:43:05.285699 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: Connection: close Jun 06 10:43:05.285699 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: Content-Length: 0 Jun 06 10:43:05.285699 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: Content-Type: application/json Jun 06 10:43:05.285699 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: Host: 10.222.0.42 Jun 06 10:43:05.285699 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: Openstack-System-Scope: None Jun 06 10:43:05.285699 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: User-Agent: python-urllib3/1.26.9 Jun 06 10:43:05.285699 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Auth-Token: gAAAAABindkdTi5hfwDU83R9VhMkvWDNoCDXiLpe7k4NfzgQuE9NKNHlwwxS39qNqJOxZC6I04U-PKIxWUtLJRI9QDIkTy_6J-jWfq_sDX7gjSO5-TBVY66fu2QztBfvxrVdG6V04r923VMuTI7eBl9-Tc1Ek2lWzslMW2bMYBl_aa_BZDF8fUA Jun 06 10:43:05.285699 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Domain-Id: None Jun 06 10:43:05.285699 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Domain-Name: None Jun 06 10:43:05.285699 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Identity-Status: Confirmed Jun 06 10:43:05.285699 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Is-Admin-Project: True Jun 06 10:43:05.285699 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Project-Domain-Id: default Jun 06 10:43:05.285699 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Project-Domain-Name: Default Jun 06 10:43:05.285699 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Project-Id: e2b17b61b73b4e6d81dd8ffe9cf311ea Jun 06 10:43:05.285699 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-845602198 Jun 06 10:43:05.285699 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Role: member,reader Jun 06 10:43:05.285699 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Roles: member,reader Jun 06 10:43:05.287172 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/e2b17b61b73b4e6d81dd8ffe9cf311ea"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e2b17b61b73b4e6d81dd8ffe9cf311ea"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e2b17b61b73b4e6d81dd8ffe9cf311ea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_e2b17b61b73b4e6d81dd8ffe9cf311ea", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Jun 06 10:43:05.287172 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Tenant: tempest-ServerRescueNegativeTestJSON-845602198 Jun 06 10:43:05.287172 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Tenant-Id: e2b17b61b73b4e6d81dd8ffe9cf311ea Jun 06 10:43:05.287172 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-845602198 Jun 06 10:43:05.287172 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-User: tempest-ServerRescueNegativeTestJSON-845602198-project Jun 06 10:43:05.287172 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-User-Domain-Id: default Jun 06 10:43:05.287172 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-User-Domain-Name: Default Jun 06 10:43:05.287172 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-User-Id: f269e146c844480c822347c3a38d103b Jun 06 10:43:05.287172 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-User-Name: tempest-ServerRescueNegativeTestJSON-845602198-project Jun 06 10:43:05.287172 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: method: > Jun 06 10:43:05.287172 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: exception: Instance d4d7ae82-4a52-4e0e-87b5-13a5b95cc3a0 could not be found. Jun 06 10:43:05.287172 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: action_args: {'id': 'd4d7ae82-4a52-4e0e-87b5-13a5b95cc3a0'} Jun 06 10:43:05.287939 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 10:43:05.287939 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 10:43:05.287939 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 06 10:43:05.287939 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 06 10:43:05.287939 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 06 10:43:05.287939 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 06 10:43:05.287939 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 06 10:43:05.287939 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 06 10:43:05.287939 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 06 10:43:05.287939 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 06 10:43:05.287939 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d4d7ae82-4a52-4e0e-87b5-13a5b95cc3a0 could not be found. Jun 06 10:43:05.287939 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi Jun 06 10:43:05.287939 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 10:43:05.287939 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi Jun 06 10:43:05.287939 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 10:43:05.287939 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 10:43:05.287939 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 10:43:05.287939 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 10:43:05.287939 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 10:43:05.287939 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 10:43:05.289208 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 10:43:05.289208 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 06 10:43:05.289208 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 06 10:43:05.289208 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 06 10:43:05.289208 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 06 10:43:05.289208 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 06 10:43:05.289208 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 06 10:43:05.289208 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d4d7ae82-4a52-4e0e-87b5-13a5b95cc3a0 could not be found. Jun 06 10:43:05.289208 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi Jun 06 10:43:05.289208 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 10:43:05.289208 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi Jun 06 10:43:05.289208 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 10:43:05.289208 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 10:43:05.289208 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 10:43:05.289208 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 10:43:05.289208 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 10:43:05.289208 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d4d7ae82-4a52-4e0e-87b5-13a5b95cc3a0 could not be found. Jun 06 10:43:05.289208 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi Jun 06 10:43:05.290247 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-f527f4aa-9093-4912-b486-a564afe00c59 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Returning 404 to user: Instance d4d7ae82-4a52-4e0e-87b5-13a5b95cc3a0 could not be found. {{(pid=129350) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 10:43:05.290247 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-f527f4aa-9093-4912-b486-a564afe00c59 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] 10.222.0.42 "GET /compute/v2.1/servers/d4d7ae82-4a52-4e0e-87b5-13a5b95cc3a0" status: 404 len: 111 microversion: 2.1 time: 0.030349 Jun 06 10:43:05.290247 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 276/571] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:43:05 2022] GET /compute/v2.1/servers/d4d7ae82-4a52-4e0e-87b5-13a5b95cc3a0 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 06 10:43:05.295551 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-fc0f19a4-553d-47b3-8ad7-5cb1dcaea72b tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Calling method '.version_select at 0x7f8fd805e5e0>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:43:05.313587 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-fc0f19a4-553d-47b3-8ad7-5cb1dcaea72b tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-993652485" status: 202 len: 0 microversion: 2.1 time: 0.021689 Jun 06 10:43:05.314148 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 296/572] 10.222.0.42 () {58 vars in 1217 bytes} [Mon Jun 6 10:43:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-993652485 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 06 10:43:08.179358 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-43c5f69e-c71f-414c-a75d-8c2f1fd0f96c tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:43:08.179978 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-43c5f69e-c71f-414c-a75d-8c2f1fd0f96c tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] [instance: 3bdaf03c-d0a2-4d6c-b0f1-ec2d580e63ef] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:43:08.183594 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG dbcounter [-] [129350] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=6,nova_api:DELETE=1 {{(pid=129350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 10:43:08.188228 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-43c5f69e-c71f-414c-a75d-8c2f1fd0f96c tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:43:08.188679 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-43c5f69e-c71f-414c-a75d-8c2f1fd0f96c tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:43:08.189459 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-43c5f69e-c71f-414c-a75d-8c2f1fd0f96c tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:43:08.189898 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-43c5f69e-c71f-414c-a75d-8c2f1fd0f96c tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:43:08.217279 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-43c5f69e-c71f-414c-a75d-8c2f1fd0f96c tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] [instance: 3bdaf03c-d0a2-4d6c-b0f1-ec2d580e63ef] Going to try to terminate instance {{(pid=129350) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 06 10:43:08.289540 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-43c5f69e-c71f-414c-a75d-8c2f1fd0f96c tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] 10.222.0.42 "DELETE /compute/v2.1/servers/3bdaf03c-d0a2-4d6c-b0f1-ec2d580e63ef" status: 204 len: 0 microversion: 2.1 time: 0.113750 Jun 06 10:43:08.290100 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 277/573] 10.222.0.42 () {58 vars in 1238 bytes} [Mon Jun 6 10:43:08 2022] DELETE /compute/v2.1/servers/3bdaf03c-d0a2-4d6c-b0f1-ec2d580e63ef => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 06 10:43:08.298663 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-b07692d2-c9fe-4ba4-95de-05e2c6514258 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:43:08.299299 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-b07692d2-c9fe-4ba4-95de-05e2c6514258 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] [instance: 3bdaf03c-d0a2-4d6c-b0f1-ec2d580e63ef] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:43:08.301369 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG dbcounter [-] [129349] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=2,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=129349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 10:43:08.308472 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-b07692d2-c9fe-4ba4-95de-05e2c6514258 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:43:08.308914 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-b07692d2-c9fe-4ba4-95de-05e2c6514258 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:43:08.309699 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-b07692d2-c9fe-4ba4-95de-05e2c6514258 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:43:08.310131 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-b07692d2-c9fe-4ba4-95de-05e2c6514258 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:43:08.442046 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-b07692d2-c9fe-4ba4-95de-05e2c6514258 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f269e146c844480c822347c3a38d103b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2b17b61b73b4e6d81dd8ffe9cf311ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:43:08.450227 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-b07692d2-c9fe-4ba4-95de-05e2c6514258 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] 10.222.0.42 "GET /compute/v2.1/servers/3bdaf03c-d0a2-4d6c-b0f1-ec2d580e63ef" status: 200 len: 1508 microversion: 2.1 time: 0.155954 Jun 06 10:43:08.450854 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 297/574] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:43:08 2022] GET /compute/v2.1/servers/3bdaf03c-d0a2-4d6c-b0f1-ec2d580e63ef => generated 1508 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:43:09.469241 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-a52a5dd3-035e-45a8-81b6-cbd09535af01 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:43:09.469931 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-a52a5dd3-035e-45a8-81b6-cbd09535af01 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] [instance: 3bdaf03c-d0a2-4d6c-b0f1-ec2d580e63ef] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:43:09.476333 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-a52a5dd3-035e-45a8-81b6-cbd09535af01 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:43:09.476769 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-a52a5dd3-035e-45a8-81b6-cbd09535af01 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:43:09.477526 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-a52a5dd3-035e-45a8-81b6-cbd09535af01 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:43:09.477950 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-a52a5dd3-035e-45a8-81b6-cbd09535af01 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:43:09.658220 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-a52a5dd3-035e-45a8-81b6-cbd09535af01 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f269e146c844480c822347c3a38d103b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2b17b61b73b4e6d81dd8ffe9cf311ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:43:09.666139 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-a52a5dd3-035e-45a8-81b6-cbd09535af01 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] 10.222.0.42 "GET /compute/v2.1/servers/3bdaf03c-d0a2-4d6c-b0f1-ec2d580e63ef" status: 200 len: 1508 microversion: 2.1 time: 0.201807 Jun 06 10:43:09.666712 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 278/575] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:43:09 2022] GET /compute/v2.1/servers/3bdaf03c-d0a2-4d6c-b0f1-ec2d580e63ef => generated 1508 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:43:10.683170 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-1b587deb-48c9-434c-8e00-cb851f41ef4f tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:43:10.683772 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-1b587deb-48c9-434c-8e00-cb851f41ef4f tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] [instance: 3bdaf03c-d0a2-4d6c-b0f1-ec2d580e63ef] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:43:10.691586 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-1b587deb-48c9-434c-8e00-cb851f41ef4f tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:43:10.692062 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-1b587deb-48c9-434c-8e00-cb851f41ef4f tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:43:10.692842 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-1b587deb-48c9-434c-8e00-cb851f41ef4f tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:43:10.693298 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-1b587deb-48c9-434c-8e00-cb851f41ef4f tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:43:10.830834 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-1b587deb-48c9-434c-8e00-cb851f41ef4f tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f269e146c844480c822347c3a38d103b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2b17b61b73b4e6d81dd8ffe9cf311ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:43:10.840264 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-1b587deb-48c9-434c-8e00-cb851f41ef4f tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] 10.222.0.42 "GET /compute/v2.1/servers/3bdaf03c-d0a2-4d6c-b0f1-ec2d580e63ef" status: 200 len: 1508 microversion: 2.1 time: 0.161039 Jun 06 10:43:10.840841 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 298/576] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:43:10 2022] GET /compute/v2.1/servers/3bdaf03c-d0a2-4d6c-b0f1-ec2d580e63ef => generated 1508 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:43:11.433721 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-264bba20-aa20-47fa-be4d-9a272664f99a tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 10:43:11.434302 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-264bba20-aa20-47fa-be4d-9a272664f99a tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] [instance: f835921f-5523-4063-89d9-1fe690669fb9] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:43:11.441205 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-264bba20-aa20-47fa-be4d-9a272664f99a tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:43:11.441651 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-264bba20-aa20-47fa-be4d-9a272664f99a tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:43:11.442412 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-264bba20-aa20-47fa-be4d-9a272664f99a tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:43:11.442836 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-264bba20-aa20-47fa-be4d-9a272664f99a tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:43:11.483184 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.objects.instance [None req-264bba20-aa20-47fa-be4d-9a272664f99a tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Lazy-loading 'flavor' on Instance uuid f835921f-5523-4063-89d9-1fe690669fb9 {{(pid=129350) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 06 10:43:11.523438 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [req-85450def-ab14-484c-817e-a5cadd18c425 req-4165c9fa-d4f7-4c36-8d2d-0119cb984561 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3bdaf03c-d0a2-4d6c-b0f1-ec2d580e63ef", "name": "network-vif-deleted", "tag": "d62ce760-3526-43c3-ad0f-43053dbe7424"}]} {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 10:43:11.532860 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [req-85450def-ab14-484c-817e-a5cadd18c425 req-4165c9fa-d4f7-4c36-8d2d-0119cb984561 service nova] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:43:11.533308 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [req-85450def-ab14-484c-817e-a5cadd18c425 req-4165c9fa-d4f7-4c36-8d2d-0119cb984561 service nova] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:43:11.544701 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.compute.server_external_events [req-85450def-ab14-484c-817e-a5cadd18c425 req-4165c9fa-d4f7-4c36-8d2d-0119cb984561 service nova] Creating event network-vif-deleted:d62ce760-3526-43c3-ad0f-43053dbe7424 for instance 3bdaf03c-d0a2-4d6c-b0f1-ec2d580e63ef on hv-cinder-84482 Jun 06 10:43:11.549804 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [req-85450def-ab14-484c-817e-a5cadd18c425 req-4165c9fa-d4f7-4c36-8d2d-0119cb984561 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029908 Jun 06 10:43:11.553337 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 299/577] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Jun 6 10:43:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 10:43:11.580670 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-264bba20-aa20-47fa-be4d-9a272664f99a tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] 10.222.0.42 "POST /compute/v2.1/servers/f835921f-5523-4063-89d9-1fe690669fb9/action" status: 202 len: 0 microversion: 2.1 time: 0.151276 Jun 06 10:43:11.581275 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 279/578] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Jun 6 10:43:11 2022] POST /compute/v2.1/servers/f835921f-5523-4063-89d9-1fe690669fb9/action => generated 0 bytes in 153 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 06 10:43:11.590922 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-5fd5c306-6e81-49bf-8947-080ac2a27aa3 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:43:11.593161 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-5fd5c306-6e81-49bf-8947-080ac2a27aa3 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] [instance: f835921f-5523-4063-89d9-1fe690669fb9] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:43:11.600039 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-5fd5c306-6e81-49bf-8947-080ac2a27aa3 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:43:11.600489 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-5fd5c306-6e81-49bf-8947-080ac2a27aa3 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:43:11.601840 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-5fd5c306-6e81-49bf-8947-080ac2a27aa3 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:43:11.602472 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-5fd5c306-6e81-49bf-8947-080ac2a27aa3 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:43:11.740928 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-5fd5c306-6e81-49bf-8947-080ac2a27aa3 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d09fe912b4c4cab81b00df801f69680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2496096b374f399606bff9a08b65eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:43:11.748529 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-5fd5c306-6e81-49bf-8947-080ac2a27aa3 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] 10.222.0.42 "GET /compute/v2.1/servers/f835921f-5523-4063-89d9-1fe690669fb9" status: 200 len: 1569 microversion: 2.1 time: 0.162735 Jun 06 10:43:11.749260 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 300/579] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:43:11 2022] GET /compute/v2.1/servers/f835921f-5523-4063-89d9-1fe690669fb9 => generated 1569 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:43:11.858171 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-0f1f465d-bf78-4642-b843-06b9847b9e75 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:43:11.858903 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-0f1f465d-bf78-4642-b843-06b9847b9e75 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] [instance: 3bdaf03c-d0a2-4d6c-b0f1-ec2d580e63ef] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:43:11.865259 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-0f1f465d-bf78-4642-b843-06b9847b9e75 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:43:11.865701 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-0f1f465d-bf78-4642-b843-06b9847b9e75 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:43:11.866468 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-0f1f465d-bf78-4642-b843-06b9847b9e75 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:43:11.866894 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-0f1f465d-bf78-4642-b843-06b9847b9e75 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:43:11.869751 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG dbcounter [-] [129350] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=3,nova_cell1:UPDATE=3 {{(pid=129350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 10:43:11.902304 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-0f1f465d-bf78-4642-b843-06b9847b9e75 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:43:11.902743 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-0f1f465d-bf78-4642-b843-06b9847b9e75 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:43:11.903187 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.objects.instance [None req-0f1f465d-bf78-4642-b843-06b9847b9e75 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lazy-loading 'fault' on Instance uuid 3bdaf03c-d0a2-4d6c-b0f1-ec2d580e63ef {{(pid=129350) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 06 10:43:11.945489 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-0f1f465d-bf78-4642-b843-06b9847b9e75 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f269e146c844480c822347c3a38d103b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2b17b61b73b4e6d81dd8ffe9cf311ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:43:11.953527 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-0f1f465d-bf78-4642-b843-06b9847b9e75 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] 10.222.0.42 "GET /compute/v2.1/servers/3bdaf03c-d0a2-4d6c-b0f1-ec2d580e63ef" status: 200 len: 1312 microversion: 2.1 time: 0.099630 Jun 06 10:43:11.954071 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 280/580] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:43:11 2022] GET /compute/v2.1/servers/3bdaf03c-d0a2-4d6c-b0f1-ec2d580e63ef => generated 1312 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:43:12.766441 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-48c4e1dc-8389-41b9-bb82-6bc5a037a82a tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:43:12.767054 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-48c4e1dc-8389-41b9-bb82-6bc5a037a82a tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] [instance: f835921f-5523-4063-89d9-1fe690669fb9] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:43:12.773527 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-48c4e1dc-8389-41b9-bb82-6bc5a037a82a tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:43:12.773969 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-48c4e1dc-8389-41b9-bb82-6bc5a037a82a tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:43:12.774785 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-48c4e1dc-8389-41b9-bb82-6bc5a037a82a tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:43:12.775217 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-48c4e1dc-8389-41b9-bb82-6bc5a037a82a tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:43:12.910855 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-48c4e1dc-8389-41b9-bb82-6bc5a037a82a tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d09fe912b4c4cab81b00df801f69680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2496096b374f399606bff9a08b65eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:43:12.918398 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-48c4e1dc-8389-41b9-bb82-6bc5a037a82a tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] 10.222.0.42 "GET /compute/v2.1/servers/f835921f-5523-4063-89d9-1fe690669fb9" status: 200 len: 1569 microversion: 2.1 time: 0.156435 Jun 06 10:43:12.918954 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 301/581] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:43:12 2022] GET /compute/v2.1/servers/f835921f-5523-4063-89d9-1fe690669fb9 => generated 1569 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:43:12.970748 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-66d13b3b-2b7b-44c4-9f75-de83f376ac47 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:43:12.971352 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-66d13b3b-2b7b-44c4-9f75-de83f376ac47 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] [instance: 3bdaf03c-d0a2-4d6c-b0f1-ec2d580e63ef] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:43:12.977996 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-66d13b3b-2b7b-44c4-9f75-de83f376ac47 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:43:12.978442 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-66d13b3b-2b7b-44c4-9f75-de83f376ac47 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:43:12.979259 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-66d13b3b-2b7b-44c4-9f75-de83f376ac47 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:43:12.979694 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-66d13b3b-2b7b-44c4-9f75-de83f376ac47 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:43:12.993455 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.wsgi [None req-66d13b3b-2b7b-44c4-9f75-de83f376ac47 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] HTTP exception thrown: Instance 3bdaf03c-d0a2-4d6c-b0f1-ec2d580e63ef could not be found. Jun 06 10:43:12.995054 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-66d13b3b-2b7b-44c4-9f75-de83f376ac47 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Request method failure captured: Jun 06 10:43:12.995054 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: request: GET /compute/v2.1/servers/3bdaf03c-d0a2-4d6c-b0f1-ec2d580e63ef HTTP/1.1 Jun 06 10:43:12.995054 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: Accept: application/json Jun 06 10:43:12.995054 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: Accept-Encoding: identity Jun 06 10:43:12.995054 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: Connection: close Jun 06 10:43:12.995054 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: Content-Length: 0 Jun 06 10:43:12.995054 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: Content-Type: application/json Jun 06 10:43:12.995054 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: Host: 10.222.0.42 Jun 06 10:43:12.995054 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: Openstack-System-Scope: None Jun 06 10:43:12.995054 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: User-Agent: python-urllib3/1.26.9 Jun 06 10:43:12.995054 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Auth-Token: gAAAAABindkdTi5hfwDU83R9VhMkvWDNoCDXiLpe7k4NfzgQuE9NKNHlwwxS39qNqJOxZC6I04U-PKIxWUtLJRI9QDIkTy_6J-jWfq_sDX7gjSO5-TBVY66fu2QztBfvxrVdG6V04r923VMuTI7eBl9-Tc1Ek2lWzslMW2bMYBl_aa_BZDF8fUA Jun 06 10:43:12.995054 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Domain-Id: None Jun 06 10:43:12.995054 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Domain-Name: None Jun 06 10:43:12.995054 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Identity-Status: Confirmed Jun 06 10:43:12.995054 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Is-Admin-Project: True Jun 06 10:43:12.995054 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Project-Domain-Id: default Jun 06 10:43:12.995054 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Project-Domain-Name: Default Jun 06 10:43:12.995054 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Project-Id: e2b17b61b73b4e6d81dd8ffe9cf311ea Jun 06 10:43:12.995054 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-845602198 Jun 06 10:43:12.995054 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Role: member,reader Jun 06 10:43:12.995054 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Roles: member,reader Jun 06 10:43:12.996709 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/e2b17b61b73b4e6d81dd8ffe9cf311ea"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e2b17b61b73b4e6d81dd8ffe9cf311ea"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e2b17b61b73b4e6d81dd8ffe9cf311ea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_e2b17b61b73b4e6d81dd8ffe9cf311ea", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Jun 06 10:43:12.996709 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Tenant: tempest-ServerRescueNegativeTestJSON-845602198 Jun 06 10:43:12.996709 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Tenant-Id: e2b17b61b73b4e6d81dd8ffe9cf311ea Jun 06 10:43:12.996709 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-845602198 Jun 06 10:43:12.996709 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-User: tempest-ServerRescueNegativeTestJSON-845602198-project Jun 06 10:43:12.996709 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-User-Domain-Id: default Jun 06 10:43:12.996709 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-User-Domain-Name: Default Jun 06 10:43:12.996709 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-User-Id: f269e146c844480c822347c3a38d103b Jun 06 10:43:12.996709 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-User-Name: tempest-ServerRescueNegativeTestJSON-845602198-project Jun 06 10:43:12.996709 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: method: > Jun 06 10:43:12.996709 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: exception: Instance 3bdaf03c-d0a2-4d6c-b0f1-ec2d580e63ef could not be found. Jun 06 10:43:12.996709 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: action_args: {'id': '3bdaf03c-d0a2-4d6c-b0f1-ec2d580e63ef'} Jun 06 10:43:12.997458 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 10:43:12.997458 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 10:43:12.997458 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 06 10:43:12.997458 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 06 10:43:12.997458 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 06 10:43:12.997458 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 06 10:43:12.997458 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 06 10:43:12.997458 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 06 10:43:12.997458 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 06 10:43:12.997458 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 06 10:43:12.997458 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3bdaf03c-d0a2-4d6c-b0f1-ec2d580e63ef could not be found. Jun 06 10:43:12.997458 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi Jun 06 10:43:12.997458 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 10:43:12.997458 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi Jun 06 10:43:12.997458 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 10:43:12.997458 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 10:43:12.997458 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 10:43:12.997458 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 10:43:12.997458 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 10:43:12.997458 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 10:43:12.998722 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 10:43:12.998722 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 06 10:43:12.998722 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 06 10:43:12.998722 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 06 10:43:12.998722 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 06 10:43:12.998722 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 06 10:43:12.998722 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 06 10:43:12.998722 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3bdaf03c-d0a2-4d6c-b0f1-ec2d580e63ef could not be found. Jun 06 10:43:12.998722 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi Jun 06 10:43:12.998722 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 10:43:12.998722 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi Jun 06 10:43:12.998722 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 10:43:12.998722 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 10:43:12.998722 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 10:43:12.998722 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 10:43:12.998722 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 10:43:12.998722 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3bdaf03c-d0a2-4d6c-b0f1-ec2d580e63ef could not be found. Jun 06 10:43:12.998722 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi Jun 06 10:43:13.000060 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-66d13b3b-2b7b-44c4-9f75-de83f376ac47 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Returning 404 to user: Instance 3bdaf03c-d0a2-4d6c-b0f1-ec2d580e63ef could not be found. {{(pid=129350) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 10:43:13.000060 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-66d13b3b-2b7b-44c4-9f75-de83f376ac47 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] 10.222.0.42 "GET /compute/v2.1/servers/3bdaf03c-d0a2-4d6c-b0f1-ec2d580e63ef" status: 404 len: 111 microversion: 2.1 time: 0.030199 Jun 06 10:43:13.000060 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 281/582] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:43:12 2022] GET /compute/v2.1/servers/3bdaf03c-d0a2-4d6c-b0f1-ec2d580e63ef => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 06 10:43:13.005205 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-a112c8b0-593d-40f9-bc54-50a56a20d3d6 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:43:13.005703 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-a112c8b0-593d-40f9-bc54-50a56a20d3d6 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] [instance: 6345448b-01b7-4429-bb10-fc5ae449ef71] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:43:13.011676 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-a112c8b0-593d-40f9-bc54-50a56a20d3d6 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:43:13.012176 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-a112c8b0-593d-40f9-bc54-50a56a20d3d6 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:43:13.012940 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-a112c8b0-593d-40f9-bc54-50a56a20d3d6 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:43:13.013376 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-a112c8b0-593d-40f9-bc54-50a56a20d3d6 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:43:13.038351 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-a112c8b0-593d-40f9-bc54-50a56a20d3d6 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] [instance: 6345448b-01b7-4429-bb10-fc5ae449ef71] Going to try to terminate instance {{(pid=129349) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 06 10:43:13.109713 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-a112c8b0-593d-40f9-bc54-50a56a20d3d6 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] 10.222.0.42 "DELETE /compute/v2.1/servers/6345448b-01b7-4429-bb10-fc5ae449ef71" status: 204 len: 0 microversion: 2.1 time: 0.107902 Jun 06 10:43:13.110471 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 302/583] 10.222.0.42 () {58 vars in 1238 bytes} [Mon Jun 6 10:43:13 2022] DELETE /compute/v2.1/servers/6345448b-01b7-4429-bb10-fc5ae449ef71 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 06 10:43:13.120002 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-8fdae244-3b49-4f6f-b183-4d5b97934ddc tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:43:13.120602 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-8fdae244-3b49-4f6f-b183-4d5b97934ddc tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] [instance: 6345448b-01b7-4429-bb10-fc5ae449ef71] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:43:13.127123 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-8fdae244-3b49-4f6f-b183-4d5b97934ddc tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:43:13.127566 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-8fdae244-3b49-4f6f-b183-4d5b97934ddc tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:43:13.128340 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-8fdae244-3b49-4f6f-b183-4d5b97934ddc tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:43:13.128765 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-8fdae244-3b49-4f6f-b183-4d5b97934ddc tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:43:13.259431 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-8fdae244-3b49-4f6f-b183-4d5b97934ddc tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f269e146c844480c822347c3a38d103b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2b17b61b73b4e6d81dd8ffe9cf311ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:43:13.268735 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-8fdae244-3b49-4f6f-b183-4d5b97934ddc tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] 10.222.0.42 "GET /compute/v2.1/servers/6345448b-01b7-4429-bb10-fc5ae449ef71" status: 200 len: 1522 microversion: 2.1 time: 0.152825 Jun 06 10:43:13.269322 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 282/584] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:43:13 2022] GET /compute/v2.1/servers/6345448b-01b7-4429-bb10-fc5ae449ef71 => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 10:43:13.937086 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-ea38c367-2e1d-4f7b-80e9-d57eaf3d4381 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:43:13.937818 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-ea38c367-2e1d-4f7b-80e9-d57eaf3d4381 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] [instance: f835921f-5523-4063-89d9-1fe690669fb9] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:43:13.944250 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-ea38c367-2e1d-4f7b-80e9-d57eaf3d4381 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:43:13.944692 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-ea38c367-2e1d-4f7b-80e9-d57eaf3d4381 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:43:13.945455 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-ea38c367-2e1d-4f7b-80e9-d57eaf3d4381 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:43:13.945887 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-ea38c367-2e1d-4f7b-80e9-d57eaf3d4381 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:43:14.076457 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-ea38c367-2e1d-4f7b-80e9-d57eaf3d4381 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d09fe912b4c4cab81b00df801f69680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2496096b374f399606bff9a08b65eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:43:14.084230 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-ea38c367-2e1d-4f7b-80e9-d57eaf3d4381 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] 10.222.0.42 "GET /compute/v2.1/servers/f835921f-5523-4063-89d9-1fe690669fb9" status: 200 len: 1569 microversion: 2.1 time: 0.151981 Jun 06 10:43:14.084797 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 303/585] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:43:13 2022] GET /compute/v2.1/servers/f835921f-5523-4063-89d9-1fe690669fb9 => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:43:14.286673 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-775ef82a-9fdf-42fc-9a9c-91c32683693e tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:43:14.287281 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-775ef82a-9fdf-42fc-9a9c-91c32683693e tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] [instance: 6345448b-01b7-4429-bb10-fc5ae449ef71] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:43:14.293284 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-775ef82a-9fdf-42fc-9a9c-91c32683693e tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:43:14.293772 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-775ef82a-9fdf-42fc-9a9c-91c32683693e tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:43:14.294485 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-775ef82a-9fdf-42fc-9a9c-91c32683693e tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:43:14.294919 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-775ef82a-9fdf-42fc-9a9c-91c32683693e tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:43:14.428035 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-775ef82a-9fdf-42fc-9a9c-91c32683693e tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f269e146c844480c822347c3a38d103b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2b17b61b73b4e6d81dd8ffe9cf311ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:43:14.435404 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-775ef82a-9fdf-42fc-9a9c-91c32683693e tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] 10.222.0.42 "GET /compute/v2.1/servers/6345448b-01b7-4429-bb10-fc5ae449ef71" status: 200 len: 1522 microversion: 2.1 time: 0.152758 Jun 06 10:43:14.436035 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 283/586] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:43:14 2022] GET /compute/v2.1/servers/6345448b-01b7-4429-bb10-fc5ae449ef71 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:43:15.101573 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-36106eaa-5227-404f-b807-ea834735f038 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:43:15.102130 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-36106eaa-5227-404f-b807-ea834735f038 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] [instance: f835921f-5523-4063-89d9-1fe690669fb9] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:43:15.108810 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-36106eaa-5227-404f-b807-ea834735f038 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:43:15.109263 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-36106eaa-5227-404f-b807-ea834735f038 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:43:15.110031 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-36106eaa-5227-404f-b807-ea834735f038 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:43:15.110471 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-36106eaa-5227-404f-b807-ea834735f038 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:43:15.250293 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-36106eaa-5227-404f-b807-ea834735f038 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d09fe912b4c4cab81b00df801f69680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2496096b374f399606bff9a08b65eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:43:15.262251 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-36106eaa-5227-404f-b807-ea834735f038 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] 10.222.0.42 "GET /compute/v2.1/servers/f835921f-5523-4063-89d9-1fe690669fb9" status: 200 len: 1569 microversion: 2.1 time: 0.164701 Jun 06 10:43:15.262814 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 304/587] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:43:15 2022] GET /compute/v2.1/servers/f835921f-5523-4063-89d9-1fe690669fb9 => generated 1569 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:43:15.454272 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-1dfa5680-5b0e-4f6a-9ab1-49f2fcbf7110 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:43:15.455124 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-1dfa5680-5b0e-4f6a-9ab1-49f2fcbf7110 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] [instance: 6345448b-01b7-4429-bb10-fc5ae449ef71] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:43:15.462315 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-1dfa5680-5b0e-4f6a-9ab1-49f2fcbf7110 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:43:15.462746 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-1dfa5680-5b0e-4f6a-9ab1-49f2fcbf7110 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:43:15.463538 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-1dfa5680-5b0e-4f6a-9ab1-49f2fcbf7110 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:43:15.464152 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-1dfa5680-5b0e-4f6a-9ab1-49f2fcbf7110 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:43:15.598677 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-1dfa5680-5b0e-4f6a-9ab1-49f2fcbf7110 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f269e146c844480c822347c3a38d103b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2b17b61b73b4e6d81dd8ffe9cf311ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:43:15.605978 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-1dfa5680-5b0e-4f6a-9ab1-49f2fcbf7110 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] 10.222.0.42 "GET /compute/v2.1/servers/6345448b-01b7-4429-bb10-fc5ae449ef71" status: 200 len: 1522 microversion: 2.1 time: 0.156537 Jun 06 10:43:15.606522 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 284/588] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:43:15 2022] GET /compute/v2.1/servers/6345448b-01b7-4429-bb10-fc5ae449ef71 => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:43:16.281362 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-9cc5b8da-6363-4b9c-a46b-da0fabc37fa7 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:43:16.281890 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-9cc5b8da-6363-4b9c-a46b-da0fabc37fa7 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] [instance: f835921f-5523-4063-89d9-1fe690669fb9] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:43:16.288366 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-9cc5b8da-6363-4b9c-a46b-da0fabc37fa7 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:43:16.288816 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-9cc5b8da-6363-4b9c-a46b-da0fabc37fa7 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:43:16.289577 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-9cc5b8da-6363-4b9c-a46b-da0fabc37fa7 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:43:16.290015 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-9cc5b8da-6363-4b9c-a46b-da0fabc37fa7 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:43:16.420102 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-9cc5b8da-6363-4b9c-a46b-da0fabc37fa7 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d09fe912b4c4cab81b00df801f69680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2496096b374f399606bff9a08b65eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:43:16.428215 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-9cc5b8da-6363-4b9c-a46b-da0fabc37fa7 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] 10.222.0.42 "GET /compute/v2.1/servers/f835921f-5523-4063-89d9-1fe690669fb9" status: 200 len: 1569 microversion: 2.1 time: 0.151289 Jun 06 10:43:16.428783 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 305/589] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:43:16 2022] GET /compute/v2.1/servers/f835921f-5523-4063-89d9-1fe690669fb9 => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:43:16.622410 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-7d7a540c-1827-45bd-b8bd-fa8d650d275a tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:43:16.622977 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-7d7a540c-1827-45bd-b8bd-fa8d650d275a tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] [instance: 6345448b-01b7-4429-bb10-fc5ae449ef71] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:43:16.629367 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-7d7a540c-1827-45bd-b8bd-fa8d650d275a tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:43:16.629820 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-7d7a540c-1827-45bd-b8bd-fa8d650d275a tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:43:16.630579 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-7d7a540c-1827-45bd-b8bd-fa8d650d275a tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:43:16.631016 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-7d7a540c-1827-45bd-b8bd-fa8d650d275a tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:43:16.761883 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-7d7a540c-1827-45bd-b8bd-fa8d650d275a tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f269e146c844480c822347c3a38d103b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2b17b61b73b4e6d81dd8ffe9cf311ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:43:16.770517 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-7d7a540c-1827-45bd-b8bd-fa8d650d275a tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] 10.222.0.42 "GET /compute/v2.1/servers/6345448b-01b7-4429-bb10-fc5ae449ef71" status: 200 len: 1522 microversion: 2.1 time: 0.152020 Jun 06 10:43:16.771078 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 285/590] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:43:16 2022] GET /compute/v2.1/servers/6345448b-01b7-4429-bb10-fc5ae449ef71 => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:43:17.272185 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [req-e09d1d42-326f-4c73-9687-925add581e7c req-0cb66240-3401-4b83-9a54-ace96b3ed075 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6345448b-01b7-4429-bb10-fc5ae449ef71", "name": "network-vif-deleted", "tag": "78530f9c-98da-46f9-99ec-e1825fb9f8d3"}]} {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 10:43:17.285621 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [req-e09d1d42-326f-4c73-9687-925add581e7c req-0cb66240-3401-4b83-9a54-ace96b3ed075 service nova] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:43:17.286511 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [req-e09d1d42-326f-4c73-9687-925add581e7c req-0cb66240-3401-4b83-9a54-ace96b3ed075 service nova] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:43:17.302178 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.compute.server_external_events [req-e09d1d42-326f-4c73-9687-925add581e7c req-0cb66240-3401-4b83-9a54-ace96b3ed075 service nova] Creating event network-vif-deleted:78530f9c-98da-46f9-99ec-e1825fb9f8d3 for instance 6345448b-01b7-4429-bb10-fc5ae449ef71 on hv-cinder-84482 Jun 06 10:43:17.309141 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [req-e09d1d42-326f-4c73-9687-925add581e7c req-0cb66240-3401-4b83-9a54-ace96b3ed075 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041553 Jun 06 10:43:17.309730 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 306/591] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Jun 6 10:43:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 06 10:43:17.445243 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-5bf905d8-e449-466e-b45d-b811324783f1 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:43:17.445851 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-5bf905d8-e449-466e-b45d-b811324783f1 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] [instance: f835921f-5523-4063-89d9-1fe690669fb9] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:43:17.452027 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-5bf905d8-e449-466e-b45d-b811324783f1 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:43:17.452499 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-5bf905d8-e449-466e-b45d-b811324783f1 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:43:17.453261 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-5bf905d8-e449-466e-b45d-b811324783f1 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:43:17.453694 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-5bf905d8-e449-466e-b45d-b811324783f1 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:43:17.590723 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-5bf905d8-e449-466e-b45d-b811324783f1 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d09fe912b4c4cab81b00df801f69680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2496096b374f399606bff9a08b65eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:43:17.598785 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-5bf905d8-e449-466e-b45d-b811324783f1 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] 10.222.0.42 "GET /compute/v2.1/servers/f835921f-5523-4063-89d9-1fe690669fb9" status: 200 len: 1569 microversion: 2.1 time: 0.157296 Jun 06 10:43:17.599358 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 286/592] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:43:17 2022] GET /compute/v2.1/servers/f835921f-5523-4063-89d9-1fe690669fb9 => generated 1569 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:43:17.788570 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-12938eae-1065-4403-9e1e-8a124ffddb07 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:43:17.789188 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-12938eae-1065-4403-9e1e-8a124ffddb07 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] [instance: 6345448b-01b7-4429-bb10-fc5ae449ef71] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:43:17.796370 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-12938eae-1065-4403-9e1e-8a124ffddb07 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:43:17.796909 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-12938eae-1065-4403-9e1e-8a124ffddb07 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:43:17.797677 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-12938eae-1065-4403-9e1e-8a124ffddb07 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:43:17.798106 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-12938eae-1065-4403-9e1e-8a124ffddb07 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:43:17.811317 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.wsgi [None req-12938eae-1065-4403-9e1e-8a124ffddb07 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] HTTP exception thrown: Instance 6345448b-01b7-4429-bb10-fc5ae449ef71 could not be found. Jun 06 10:43:17.813094 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-12938eae-1065-4403-9e1e-8a124ffddb07 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Request method failure captured: Jun 06 10:43:17.813094 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: request: GET /compute/v2.1/servers/6345448b-01b7-4429-bb10-fc5ae449ef71 HTTP/1.1 Jun 06 10:43:17.813094 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: Accept: application/json Jun 06 10:43:17.813094 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: Accept-Encoding: identity Jun 06 10:43:17.813094 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: Connection: close Jun 06 10:43:17.813094 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: Content-Length: 0 Jun 06 10:43:17.813094 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: Content-Type: application/json Jun 06 10:43:17.813094 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: Host: 10.222.0.42 Jun 06 10:43:17.813094 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: Openstack-System-Scope: None Jun 06 10:43:17.813094 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: User-Agent: python-urllib3/1.26.9 Jun 06 10:43:17.813094 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Auth-Token: gAAAAABindkdTi5hfwDU83R9VhMkvWDNoCDXiLpe7k4NfzgQuE9NKNHlwwxS39qNqJOxZC6I04U-PKIxWUtLJRI9QDIkTy_6J-jWfq_sDX7gjSO5-TBVY66fu2QztBfvxrVdG6V04r923VMuTI7eBl9-Tc1Ek2lWzslMW2bMYBl_aa_BZDF8fUA Jun 06 10:43:17.813094 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Domain-Id: None Jun 06 10:43:17.813094 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Domain-Name: None Jun 06 10:43:17.813094 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Identity-Status: Confirmed Jun 06 10:43:17.813094 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Is-Admin-Project: True Jun 06 10:43:17.813094 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Project-Domain-Id: default Jun 06 10:43:17.813094 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Project-Domain-Name: Default Jun 06 10:43:17.813094 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Project-Id: e2b17b61b73b4e6d81dd8ffe9cf311ea Jun 06 10:43:17.813094 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-845602198 Jun 06 10:43:17.813094 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Role: member,reader Jun 06 10:43:17.813094 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Roles: member,reader Jun 06 10:43:17.814401 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/e2b17b61b73b4e6d81dd8ffe9cf311ea"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e2b17b61b73b4e6d81dd8ffe9cf311ea"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e2b17b61b73b4e6d81dd8ffe9cf311ea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_e2b17b61b73b4e6d81dd8ffe9cf311ea", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Jun 06 10:43:17.814401 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Tenant: tempest-ServerRescueNegativeTestJSON-845602198 Jun 06 10:43:17.814401 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Tenant-Id: e2b17b61b73b4e6d81dd8ffe9cf311ea Jun 06 10:43:17.814401 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-845602198 Jun 06 10:43:17.814401 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-User: tempest-ServerRescueNegativeTestJSON-845602198-project Jun 06 10:43:17.814401 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-User-Domain-Id: default Jun 06 10:43:17.814401 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-User-Domain-Name: Default Jun 06 10:43:17.814401 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-User-Id: f269e146c844480c822347c3a38d103b Jun 06 10:43:17.814401 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-User-Name: tempest-ServerRescueNegativeTestJSON-845602198-project Jun 06 10:43:17.814401 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: method: > Jun 06 10:43:17.814401 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: exception: Instance 6345448b-01b7-4429-bb10-fc5ae449ef71 could not be found. Jun 06 10:43:17.814401 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: action_args: {'id': '6345448b-01b7-4429-bb10-fc5ae449ef71'} Jun 06 10:43:17.815114 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 10:43:17.815114 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 10:43:17.815114 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 06 10:43:17.815114 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 06 10:43:17.815114 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 06 10:43:17.815114 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 06 10:43:17.815114 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 06 10:43:17.815114 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 06 10:43:17.815114 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 06 10:43:17.815114 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 06 10:43:17.815114 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6345448b-01b7-4429-bb10-fc5ae449ef71 could not be found. Jun 06 10:43:17.815114 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Jun 06 10:43:17.815114 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 10:43:17.815114 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Jun 06 10:43:17.815114 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 10:43:17.815114 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 10:43:17.815114 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 10:43:17.815114 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 10:43:17.815114 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 10:43:17.815114 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 10:43:17.816494 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 10:43:17.816494 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 06 10:43:17.816494 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 06 10:43:17.816494 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 06 10:43:17.816494 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 06 10:43:17.816494 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 06 10:43:17.816494 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 06 10:43:17.816494 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6345448b-01b7-4429-bb10-fc5ae449ef71 could not be found. Jun 06 10:43:17.816494 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Jun 06 10:43:17.816494 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 10:43:17.816494 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Jun 06 10:43:17.816494 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 10:43:17.816494 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 10:43:17.816494 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 10:43:17.816494 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 10:43:17.816494 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 10:43:17.816494 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6345448b-01b7-4429-bb10-fc5ae449ef71 could not be found. Jun 06 10:43:17.816494 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Jun 06 10:43:17.817527 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-12938eae-1065-4403-9e1e-8a124ffddb07 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] Returning 404 to user: Instance 6345448b-01b7-4429-bb10-fc5ae449ef71 could not be found. {{(pid=129349) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 10:43:17.817527 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-12938eae-1065-4403-9e1e-8a124ffddb07 tempest-ServerRescueNegativeTestJSON-845602198 tempest-ServerRescueNegativeTestJSON-845602198-project] 10.222.0.42 "GET /compute/v2.1/servers/6345448b-01b7-4429-bb10-fc5ae449ef71" status: 404 len: 111 microversion: 2.1 time: 0.030310 Jun 06 10:43:17.817527 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 307/593] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:43:17 2022] GET /compute/v2.1/servers/6345448b-01b7-4429-bb10-fc5ae449ef71 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 06 10:43:18.617612 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-5ce54ce2-2980-4823-a342-15d806a724f4 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:43:18.618221 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-5ce54ce2-2980-4823-a342-15d806a724f4 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] [instance: f835921f-5523-4063-89d9-1fe690669fb9] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:43:18.626127 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-5ce54ce2-2980-4823-a342-15d806a724f4 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:43:18.626566 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-5ce54ce2-2980-4823-a342-15d806a724f4 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:43:18.627354 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-5ce54ce2-2980-4823-a342-15d806a724f4 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:43:18.627810 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-5ce54ce2-2980-4823-a342-15d806a724f4 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:43:18.868253 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-5ce54ce2-2980-4823-a342-15d806a724f4 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d09fe912b4c4cab81b00df801f69680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2496096b374f399606bff9a08b65eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:43:18.876964 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-5ce54ce2-2980-4823-a342-15d806a724f4 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] 10.222.0.42 "GET /compute/v2.1/servers/f835921f-5523-4063-89d9-1fe690669fb9" status: 200 len: 1569 microversion: 2.1 time: 0.263963 Jun 06 10:43:18.877766 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 287/594] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:43:18 2022] GET /compute/v2.1/servers/f835921f-5523-4063-89d9-1fe690669fb9 => generated 1569 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:43:19.894745 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-17a634c1-d398-486c-9216-d54f7f36d64d tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:43:19.895353 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-17a634c1-d398-486c-9216-d54f7f36d64d tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] [instance: f835921f-5523-4063-89d9-1fe690669fb9] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:43:19.902157 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-17a634c1-d398-486c-9216-d54f7f36d64d tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:43:19.902596 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-17a634c1-d398-486c-9216-d54f7f36d64d tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:43:19.903358 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-17a634c1-d398-486c-9216-d54f7f36d64d tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:43:19.904011 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-17a634c1-d398-486c-9216-d54f7f36d64d tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:43:20.138292 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-17a634c1-d398-486c-9216-d54f7f36d64d tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d09fe912b4c4cab81b00df801f69680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2496096b374f399606bff9a08b65eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:43:20.147741 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-17a634c1-d398-486c-9216-d54f7f36d64d tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] 10.222.0.42 "GET /compute/v2.1/servers/f835921f-5523-4063-89d9-1fe690669fb9" status: 200 len: 1569 microversion: 2.1 time: 0.257072 Jun 06 10:43:20.157435 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 308/595] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:43:19 2022] GET /compute/v2.1/servers/f835921f-5523-4063-89d9-1fe690669fb9 => generated 1569 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:43:21.165130 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-0988f24f-fa0a-4c70-bcd2-ea9747ac2dc1 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:43:21.165743 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-0988f24f-fa0a-4c70-bcd2-ea9747ac2dc1 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] [instance: f835921f-5523-4063-89d9-1fe690669fb9] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:43:21.172584 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-0988f24f-fa0a-4c70-bcd2-ea9747ac2dc1 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:43:21.173364 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-0988f24f-fa0a-4c70-bcd2-ea9747ac2dc1 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:43:21.174290 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-0988f24f-fa0a-4c70-bcd2-ea9747ac2dc1 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:43:21.174728 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-0988f24f-fa0a-4c70-bcd2-ea9747ac2dc1 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:43:21.343959 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-0988f24f-fa0a-4c70-bcd2-ea9747ac2dc1 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d09fe912b4c4cab81b00df801f69680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2496096b374f399606bff9a08b65eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:43:21.353564 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-0988f24f-fa0a-4c70-bcd2-ea9747ac2dc1 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] 10.222.0.42 "GET /compute/v2.1/servers/f835921f-5523-4063-89d9-1fe690669fb9" status: 200 len: 1569 microversion: 2.1 time: 0.193065 Jun 06 10:43:21.354538 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 288/596] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:43:21 2022] GET /compute/v2.1/servers/f835921f-5523-4063-89d9-1fe690669fb9 => generated 1569 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:43:22.375407 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-6667e3e9-5629-4c86-89ff-6048694f3235 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:43:22.376099 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-6667e3e9-5629-4c86-89ff-6048694f3235 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] [instance: f835921f-5523-4063-89d9-1fe690669fb9] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:43:22.383608 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-6667e3e9-5629-4c86-89ff-6048694f3235 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:43:22.384524 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-6667e3e9-5629-4c86-89ff-6048694f3235 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:43:22.385624 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-6667e3e9-5629-4c86-89ff-6048694f3235 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:43:22.386830 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-6667e3e9-5629-4c86-89ff-6048694f3235 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:43:22.574573 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG dbcounter [-] [129349] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=96,nova_cell1:INSERT=2 {{(pid=129349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 10:43:22.696727 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-6667e3e9-5629-4c86-89ff-6048694f3235 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d09fe912b4c4cab81b00df801f69680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2496096b374f399606bff9a08b65eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:43:22.704408 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-6667e3e9-5629-4c86-89ff-6048694f3235 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] 10.222.0.42 "GET /compute/v2.1/servers/f835921f-5523-4063-89d9-1fe690669fb9" status: 200 len: 1569 microversion: 2.1 time: 0.335893 Jun 06 10:43:22.704964 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 309/597] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:43:22 2022] GET /compute/v2.1/servers/f835921f-5523-4063-89d9-1fe690669fb9 => generated 1569 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:43:23.722082 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-a3ba05fa-090f-46f4-88ee-f296547e5e0a tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:43:23.723433 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-a3ba05fa-090f-46f4-88ee-f296547e5e0a tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] [instance: f835921f-5523-4063-89d9-1fe690669fb9] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:43:23.730325 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-a3ba05fa-090f-46f4-88ee-f296547e5e0a tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:43:23.731052 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-a3ba05fa-090f-46f4-88ee-f296547e5e0a tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:43:23.732963 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-a3ba05fa-090f-46f4-88ee-f296547e5e0a tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:43:23.734140 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-a3ba05fa-090f-46f4-88ee-f296547e5e0a tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:43:23.944961 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-a3ba05fa-090f-46f4-88ee-f296547e5e0a tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d09fe912b4c4cab81b00df801f69680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2496096b374f399606bff9a08b65eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:43:23.953782 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-a3ba05fa-090f-46f4-88ee-f296547e5e0a tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] 10.222.0.42 "GET /compute/v2.1/servers/f835921f-5523-4063-89d9-1fe690669fb9" status: 200 len: 1569 microversion: 2.1 time: 0.236051 Jun 06 10:43:23.954352 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 289/598] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:43:23 2022] GET /compute/v2.1/servers/f835921f-5523-4063-89d9-1fe690669fb9 => generated 1569 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 10:43:24.115456 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-3cf6a6f0-3e79-47fb-8dcd-ebc9137fbfd4 tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-165633087"}} {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 10:43:24.116064 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-3cf6a6f0-3e79-47fb-8dcd-ebc9137fbfd4 tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] [instance: 8e9cb9c1-7df9-4cb7-9121-54bf74f552c7] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:43:24.127718 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-3cf6a6f0-3e79-47fb-8dcd-ebc9137fbfd4 tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:43:24.128465 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-3cf6a6f0-3e79-47fb-8dcd-ebc9137fbfd4 tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:43:24.129489 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-3cf6a6f0-3e79-47fb-8dcd-ebc9137fbfd4 tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:43:24.130138 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-3cf6a6f0-3e79-47fb-8dcd-ebc9137fbfd4 tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:43:24.387534 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.network.security_group_api [None req-3cf6a6f0-3e79-47fb-8dcd-ebc9137fbfd4 tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Removing security group 230a3572-5b10-48b9-ab14-7b3832584c01 from port d50634ea-b30b-4bd6-b547-ee82d39a4a57 Jun 06 10:43:24.972151 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-cef75238-247b-4670-ad1d-4c6dd36f6de7 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:43:24.973352 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-cef75238-247b-4670-ad1d-4c6dd36f6de7 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] [instance: f835921f-5523-4063-89d9-1fe690669fb9] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:43:24.981914 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-cef75238-247b-4670-ad1d-4c6dd36f6de7 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:43:24.982983 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-cef75238-247b-4670-ad1d-4c6dd36f6de7 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:43:24.983871 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-cef75238-247b-4670-ad1d-4c6dd36f6de7 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:43:24.984387 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-cef75238-247b-4670-ad1d-4c6dd36f6de7 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:43:25.589635 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-3cf6a6f0-3e79-47fb-8dcd-ebc9137fbfd4 tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] 10.222.0.42 "POST /compute/v2.1/servers/8e9cb9c1-7df9-4cb7-9121-54bf74f552c7/action" status: 202 len: 0 microversion: 2.1 time: 1.477824 Jun 06 10:43:25.597738 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 310/599] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Jun 6 10:43:24 2022] POST /compute/v2.1/servers/8e9cb9c1-7df9-4cb7-9121-54bf74f552c7/action => generated 0 bytes in 1487 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 06 10:43:25.605913 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-cef75238-247b-4670-ad1d-4c6dd36f6de7 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d09fe912b4c4cab81b00df801f69680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2496096b374f399606bff9a08b65eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:43:25.627899 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-cef75238-247b-4670-ad1d-4c6dd36f6de7 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] 10.222.0.42 "GET /compute/v2.1/servers/f835921f-5523-4063-89d9-1fe690669fb9" status: 200 len: 1510 microversion: 2.1 time: 0.660943 Jun 06 10:43:25.630480 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 290/600] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:43:24 2022] GET /compute/v2.1/servers/f835921f-5523-4063-89d9-1fe690669fb9 => generated 1510 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:43:25.653354 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-8d99f1d9-e700-4d26-9425-b19199630ae1 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 10:43:25.653977 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-8d99f1d9-e700-4d26-9425-b19199630ae1 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] [instance: f835921f-5523-4063-89d9-1fe690669fb9] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:43:25.660492 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-8d99f1d9-e700-4d26-9425-b19199630ae1 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:43:25.661478 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-8d99f1d9-e700-4d26-9425-b19199630ae1 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:43:25.662613 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-8d99f1d9-e700-4d26-9425-b19199630ae1 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:43:25.663230 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-8d99f1d9-e700-4d26-9425-b19199630ae1 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:43:25.819282 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-8d99f1d9-e700-4d26-9425-b19199630ae1 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] 10.222.0.42 "POST /compute/v2.1/servers/f835921f-5523-4063-89d9-1fe690669fb9/action" status: 202 len: 0 microversion: 2.1 time: 0.171508 Jun 06 10:43:25.824537 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 291/601] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Jun 6 10:43:25 2022] POST /compute/v2.1/servers/f835921f-5523-4063-89d9-1fe690669fb9/action => generated 0 bytes in 177 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 06 10:43:25.835819 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-0a58799b-c577-44dd-8fa3-5be1781c2d42 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:43:25.836443 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-0a58799b-c577-44dd-8fa3-5be1781c2d42 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] [instance: f835921f-5523-4063-89d9-1fe690669fb9] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:43:25.851209 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-0a58799b-c577-44dd-8fa3-5be1781c2d42 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:43:25.851981 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-0a58799b-c577-44dd-8fa3-5be1781c2d42 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:43:25.852933 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-0a58799b-c577-44dd-8fa3-5be1781c2d42 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:43:25.854722 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-0a58799b-c577-44dd-8fa3-5be1781c2d42 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:43:25.897915 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [req-3a2cd473-d1cd-4fea-aeda-7736c0685138 req-a25df8a2-6272-4b78-bec3-7487a049dc89 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8e9cb9c1-7df9-4cb7-9121-54bf74f552c7", "tag": "d50634ea-b30b-4bd6-b547-ee82d39a4a57"}]} {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 10:43:25.920048 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [req-3a2cd473-d1cd-4fea-aeda-7736c0685138 req-a25df8a2-6272-4b78-bec3-7487a049dc89 service nova] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:43:25.921940 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [req-3a2cd473-d1cd-4fea-aeda-7736c0685138 req-a25df8a2-6272-4b78-bec3-7487a049dc89 service nova] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:43:25.955873 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.compute.server_external_events [req-3a2cd473-d1cd-4fea-aeda-7736c0685138 req-a25df8a2-6272-4b78-bec3-7487a049dc89 service nova] Creating event network-changed:d50634ea-b30b-4bd6-b547-ee82d39a4a57 for instance 8e9cb9c1-7df9-4cb7-9121-54bf74f552c7 on hv-cinder-84482 Jun 06 10:43:25.969076 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [req-3a2cd473-d1cd-4fea-aeda-7736c0685138 req-a25df8a2-6272-4b78-bec3-7487a049dc89 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.369761 Jun 06 10:43:25.972489 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 311/602] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Jun 6 10:43:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 10:43:26.478305 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-0a58799b-c577-44dd-8fa3-5be1781c2d42 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d09fe912b4c4cab81b00df801f69680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2496096b374f399606bff9a08b65eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:43:26.488105 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-0a58799b-c577-44dd-8fa3-5be1781c2d42 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] 10.222.0.42 "GET /compute/v2.1/servers/f835921f-5523-4063-89d9-1fe690669fb9" status: 200 len: 1518 microversion: 2.1 time: 0.662221 Jun 06 10:43:26.488689 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 292/603] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:43:25 2022] GET /compute/v2.1/servers/f835921f-5523-4063-89d9-1fe690669fb9 => generated 1518 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:43:27.193966 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-1fc4bc03-8c7f-4757-af06-6b7fbee45509 tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:43:27.194536 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-1fc4bc03-8c7f-4757-af06-6b7fbee45509 tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] [instance: 8e9cb9c1-7df9-4cb7-9121-54bf74f552c7] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:43:27.195820 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [req-8c213e92-475e-4e56-a080-3cd5345a5785 req-96b511b8-cb45-4297-8b57-1987821c0e3e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8e9cb9c1-7df9-4cb7-9121-54bf74f552c7", "tag": "d50634ea-b30b-4bd6-b547-ee82d39a4a57"}]} {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 10:43:27.205347 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [req-8c213e92-475e-4e56-a080-3cd5345a5785 req-96b511b8-cb45-4297-8b57-1987821c0e3e service nova] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:43:27.205593 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-1fc4bc03-8c7f-4757-af06-6b7fbee45509 tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:43:27.205990 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-1fc4bc03-8c7f-4757-af06-6b7fbee45509 tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:43:27.206359 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [req-8c213e92-475e-4e56-a080-3cd5345a5785 req-96b511b8-cb45-4297-8b57-1987821c0e3e service nova] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:43:27.206763 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-1fc4bc03-8c7f-4757-af06-6b7fbee45509 tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:43:27.207184 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-1fc4bc03-8c7f-4757-af06-6b7fbee45509 tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:43:27.225138 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.compute.server_external_events [req-8c213e92-475e-4e56-a080-3cd5345a5785 req-96b511b8-cb45-4297-8b57-1987821c0e3e service nova] Creating event network-changed:d50634ea-b30b-4bd6-b547-ee82d39a4a57 for instance 8e9cb9c1-7df9-4cb7-9121-54bf74f552c7 on hv-cinder-84482 Jun 06 10:43:27.232558 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [req-8c213e92-475e-4e56-a080-3cd5345a5785 req-96b511b8-cb45-4297-8b57-1987821c0e3e service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039412 Jun 06 10:43:27.233885 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 293/604] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Jun 6 10:43:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 10:43:27.344489 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.objects.instance [None req-1fc4bc03-8c7f-4757-af06-6b7fbee45509 tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Lazy-loading 'services' on Instance uuid 8e9cb9c1-7df9-4cb7-9121-54bf74f552c7 {{(pid=129349) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 06 10:43:27.453802 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-1fc4bc03-8c7f-4757-af06-6b7fbee45509 tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] 10.222.0.42 "DELETE /compute/v2.1/servers/8e9cb9c1-7df9-4cb7-9121-54bf74f552c7/os-volume_attachments/3502fd35-e3c6-41c9-8986-b7f22033a0e6" status: 202 len: 0 microversion: 2.1 time: 0.264051 Jun 06 10:43:27.454473 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 312/605] 10.222.0.42 () {58 vars in 1415 bytes} [Mon Jun 6 10:43:27 2022] DELETE /compute/v2.1/servers/8e9cb9c1-7df9-4cb7-9121-54bf74f552c7/os-volume_attachments/3502fd35-e3c6-41c9-8986-b7f22033a0e6 => generated 0 bytes in 266 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 06 10:43:27.465207 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-190a7e96-a1fa-4964-bcd4-ae94f5a23d9b tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:43:27.466633 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-190a7e96-a1fa-4964-bcd4-ae94f5a23d9b tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] [instance: 8e9cb9c1-7df9-4cb7-9121-54bf74f552c7] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:43:27.474085 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-190a7e96-a1fa-4964-bcd4-ae94f5a23d9b tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:43:27.474962 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-190a7e96-a1fa-4964-bcd4-ae94f5a23d9b tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:43:27.476511 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-190a7e96-a1fa-4964-bcd4-ae94f5a23d9b tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:43:27.480246 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-190a7e96-a1fa-4964-bcd4-ae94f5a23d9b tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:43:27.507582 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-e780bc5b-c5ff-4a11-9fac-4fdf3f971e91 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:43:27.508180 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-e780bc5b-c5ff-4a11-9fac-4fdf3f971e91 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] [instance: f835921f-5523-4063-89d9-1fe690669fb9] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:43:27.519212 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-e780bc5b-c5ff-4a11-9fac-4fdf3f971e91 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:43:27.529865 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-190a7e96-a1fa-4964-bcd4-ae94f5a23d9b tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] 10.222.0.42 "GET /compute/v2.1/servers/8e9cb9c1-7df9-4cb7-9121-54bf74f552c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.068783 Jun 06 10:43:27.531290 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 294/606] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jun 6 10:43:27 2022] GET /compute/v2.1/servers/8e9cb9c1-7df9-4cb7-9121-54bf74f552c7/os-volume_attachments => generated 197 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 10:43:27.537927 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-e780bc5b-c5ff-4a11-9fac-4fdf3f971e91 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:43:27.538956 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-e780bc5b-c5ff-4a11-9fac-4fdf3f971e91 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:43:27.539612 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-e780bc5b-c5ff-4a11-9fac-4fdf3f971e91 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:43:27.852200 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-e780bc5b-c5ff-4a11-9fac-4fdf3f971e91 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d09fe912b4c4cab81b00df801f69680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2496096b374f399606bff9a08b65eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:43:27.860600 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-e780bc5b-c5ff-4a11-9fac-4fdf3f971e91 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] 10.222.0.42 "GET /compute/v2.1/servers/f835921f-5523-4063-89d9-1fe690669fb9" status: 200 len: 1520 microversion: 2.1 time: 0.357807 Jun 06 10:43:27.861495 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 313/607] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:43:27 2022] GET /compute/v2.1/servers/f835921f-5523-4063-89d9-1fe690669fb9 => generated 1520 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 10:43:28.363470 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [req-aed27f84-c210-4750-b67b-8e77f8b75173 req-9c6e49fb-645c-47a4-8dba-f3ac4d488b16 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f835921f-5523-4063-89d9-1fe690669fb9", "name": "network-vif-unplugged", "status": "completed", "tag": "3a3a5f7d-eb2a-4a67-83a6-a0deab7b7e1a"}]} {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 10:43:28.425822 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [req-aed27f84-c210-4750-b67b-8e77f8b75173 req-9c6e49fb-645c-47a4-8dba-f3ac4d488b16 service nova] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:43:28.426640 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [req-aed27f84-c210-4750-b67b-8e77f8b75173 req-9c6e49fb-645c-47a4-8dba-f3ac4d488b16 service nova] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:43:28.442282 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.compute.server_external_events [req-aed27f84-c210-4750-b67b-8e77f8b75173 req-9c6e49fb-645c-47a4-8dba-f3ac4d488b16 service nova] Creating event network-vif-unplugged:3a3a5f7d-eb2a-4a67-83a6-a0deab7b7e1a for instance f835921f-5523-4063-89d9-1fe690669fb9 on hv-cinder-84482 Jun 06 10:43:28.478245 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [req-aed27f84-c210-4750-b67b-8e77f8b75173 req-9c6e49fb-645c-47a4-8dba-f3ac4d488b16 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.116910 Jun 06 10:43:28.480157 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 295/608] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Jun 6 10:43:28 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 10:43:28.543279 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-b49ed839-4d44-4c46-a605-a303212a6045 tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:43:28.544467 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-b49ed839-4d44-4c46-a605-a303212a6045 tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] [instance: 8e9cb9c1-7df9-4cb7-9121-54bf74f552c7] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:43:28.560784 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-b49ed839-4d44-4c46-a605-a303212a6045 tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:43:28.561707 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-b49ed839-4d44-4c46-a605-a303212a6045 tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:43:28.563561 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-b49ed839-4d44-4c46-a605-a303212a6045 tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:43:28.565985 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-b49ed839-4d44-4c46-a605-a303212a6045 tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:43:28.633790 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-b49ed839-4d44-4c46-a605-a303212a6045 tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] 10.222.0.42 "GET /compute/v2.1/servers/8e9cb9c1-7df9-4cb7-9121-54bf74f552c7/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.095490 Jun 06 10:43:28.635011 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 314/609] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jun 6 10:43:28 2022] GET /compute/v2.1/servers/8e9cb9c1-7df9-4cb7-9121-54bf74f552c7/os-volume_attachments => generated 25 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 06 10:43:28.645876 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-43d55dd4-eed5-4c61-ac2d-6db6fb5b43d4 tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:43:28.646602 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-43d55dd4-eed5-4c61-ac2d-6db6fb5b43d4 tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] [instance: 8e9cb9c1-7df9-4cb7-9121-54bf74f552c7] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:43:28.658396 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-43d55dd4-eed5-4c61-ac2d-6db6fb5b43d4 tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:43:28.658952 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-43d55dd4-eed5-4c61-ac2d-6db6fb5b43d4 tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:43:28.659958 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-43d55dd4-eed5-4c61-ac2d-6db6fb5b43d4 tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:43:28.660351 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-43d55dd4-eed5-4c61-ac2d-6db6fb5b43d4 tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:43:28.761853 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.wsgi [None req-43d55dd4-eed5-4c61-ac2d-6db6fb5b43d4 tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] HTTP exception thrown: Instance 8e9cb9c1-7df9-4cb7-9121-54bf74f552c7 is not attached to volume 3502fd35-e3c6-41c9-8986-b7f22033a0e6 Jun 06 10:43:28.775496 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-43d55dd4-eed5-4c61-ac2d-6db6fb5b43d4 tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Request method failure captured: Jun 06 10:43:28.775496 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: request: DELETE /compute/v2.1/servers/8e9cb9c1-7df9-4cb7-9121-54bf74f552c7/os-volume_attachments/3502fd35-e3c6-41c9-8986-b7f22033a0e6 HTTP/1.1 Jun 06 10:43:28.775496 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: Accept: application/json Jun 06 10:43:28.775496 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: Accept-Encoding: identity Jun 06 10:43:28.775496 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: Connection: close Jun 06 10:43:28.775496 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: Content-Length: 0 Jun 06 10:43:28.775496 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: Content-Type: application/json Jun 06 10:43:28.775496 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: Host: 10.222.0.42 Jun 06 10:43:28.775496 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: Openstack-System-Scope: None Jun 06 10:43:28.775496 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: User-Agent: python-urllib3/1.26.9 Jun 06 10:43:28.775496 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Auth-Token: gAAAAABindm_dbdArPoNUnqh6OhCbAX2OJyd6n9DFL28BFZ3Z6cDWWjnluFo0I4bpJXOWlgFVdvl3mmxLv5ttGrqKu1iECpLAm6E8CjPCETHejCa3vLYlEGmXT9k-P7GsEdRYvVCfpEopic3tP5VRunoZgDp9ew3XrymioYjCGA9AzSR_TM_4Sk Jun 06 10:43:28.775496 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Domain-Id: None Jun 06 10:43:28.775496 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Domain-Name: None Jun 06 10:43:28.775496 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Identity-Status: Confirmed Jun 06 10:43:28.775496 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Is-Admin-Project: True Jun 06 10:43:28.775496 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Project-Domain-Id: default Jun 06 10:43:28.775496 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Project-Domain-Name: Default Jun 06 10:43:28.775496 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Project-Id: 645eadf589944a24bf6e27326a61952c Jun 06 10:43:28.775496 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Project-Name: tempest-TestMinimumBasicScenario-1630290687 Jun 06 10:43:28.775496 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Role: member,reader Jun 06 10:43:28.775496 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Roles: member,reader Jun 06 10:43:28.776964 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/645eadf589944a24bf6e27326a61952c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/645eadf589944a24bf6e27326a61952c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/645eadf589944a24bf6e27326a61952c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_645eadf589944a24bf6e27326a61952c", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Jun 06 10:43:28.776964 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Tenant: tempest-TestMinimumBasicScenario-1630290687 Jun 06 10:43:28.776964 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Tenant-Id: 645eadf589944a24bf6e27326a61952c Jun 06 10:43:28.776964 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1630290687 Jun 06 10:43:28.776964 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-User: tempest-TestMinimumBasicScenario-1630290687-project Jun 06 10:43:28.776964 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-User-Domain-Id: default Jun 06 10:43:28.776964 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-User-Domain-Name: Default Jun 06 10:43:28.776964 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-User-Id: b7b11ed004fc4ef3a1f1c48adf31fe8e Jun 06 10:43:28.776964 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-User-Name: tempest-TestMinimumBasicScenario-1630290687-project Jun 06 10:43:28.776964 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: method: > Jun 06 10:43:28.776964 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: exception: Instance 8e9cb9c1-7df9-4cb7-9121-54bf74f552c7 is not attached to volume 3502fd35-e3c6-41c9-8986-b7f22033a0e6 Jun 06 10:43:28.777865 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: action_args: {'server_id': '8e9cb9c1-7df9-4cb7-9121-54bf74f552c7', 'id': '3502fd35-e3c6-41c9-8986-b7f22033a0e6'} Jun 06 10:43:28.777865 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 10:43:28.777865 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 10:43:28.777865 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jun 06 10:43:28.777865 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jun 06 10:43:28.777865 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 06 10:43:28.777865 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 06 10:43:28.777865 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jun 06 10:43:28.777865 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jun 06 10:43:28.777865 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 3502fd35-e3c6-41c9-8986-b7f22033a0e6. Jun 06 10:43:28.777865 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi Jun 06 10:43:28.777865 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 10:43:28.777865 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi Jun 06 10:43:28.777865 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 10:43:28.777865 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 10:43:28.777865 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 10:43:28.777865 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 10:43:28.777865 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 10:43:28.777865 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 10:43:28.779828 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 10:43:28.779828 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jun 06 10:43:28.779828 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jun 06 10:43:28.779828 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8e9cb9c1-7df9-4cb7-9121-54bf74f552c7 is not attached to volume 3502fd35-e3c6-41c9-8986-b7f22033a0e6 Jun 06 10:43:28.779828 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi Jun 06 10:43:28.779828 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 10:43:28.779828 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi Jun 06 10:43:28.779828 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 10:43:28.779828 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 10:43:28.779828 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 10:43:28.779828 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 10:43:28.779828 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 10:43:28.779828 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8e9cb9c1-7df9-4cb7-9121-54bf74f552c7 is not attached to volume 3502fd35-e3c6-41c9-8986-b7f22033a0e6 Jun 06 10:43:28.779828 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi Jun 06 10:43:28.779828 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-43d55dd4-eed5-4c61-ac2d-6db6fb5b43d4 tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Returning 404 to user: Instance 8e9cb9c1-7df9-4cb7-9121-54bf74f552c7 is not attached to volume 3502fd35-e3c6-41c9-8986-b7f22033a0e6 {{(pid=129350) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 10:43:28.780889 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-43d55dd4-eed5-4c61-ac2d-6db6fb5b43d4 tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] 10.222.0.42 "DELETE /compute/v2.1/servers/8e9cb9c1-7df9-4cb7-9121-54bf74f552c7/os-volume_attachments/3502fd35-e3c6-41c9-8986-b7f22033a0e6" status: 404 len: 154 microversion: 2.1 time: 0.135897 Jun 06 10:43:28.780889 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 296/610] 10.222.0.42 () {58 vars in 1415 bytes} [Mon Jun 6 10:43:28 2022] DELETE /compute/v2.1/servers/8e9cb9c1-7df9-4cb7-9121-54bf74f552c7/os-volume_attachments/3502fd35-e3c6-41c9-8986-b7f22033a0e6 => generated 154 bytes in 140 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 06 10:43:28.878630 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-df5ee2da-7754-456e-a5f1-6e9ed6890c40 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:43:28.878816 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-df5ee2da-7754-456e-a5f1-6e9ed6890c40 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] [instance: f835921f-5523-4063-89d9-1fe690669fb9] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:43:28.889671 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-df5ee2da-7754-456e-a5f1-6e9ed6890c40 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:43:28.890161 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-df5ee2da-7754-456e-a5f1-6e9ed6890c40 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:43:28.896399 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-df5ee2da-7754-456e-a5f1-6e9ed6890c40 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:43:28.898565 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-df5ee2da-7754-456e-a5f1-6e9ed6890c40 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:43:29.608782 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-df5ee2da-7754-456e-a5f1-6e9ed6890c40 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d09fe912b4c4cab81b00df801f69680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2496096b374f399606bff9a08b65eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:43:29.616472 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-df5ee2da-7754-456e-a5f1-6e9ed6890c40 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] 10.222.0.42 "GET /compute/v2.1/servers/f835921f-5523-4063-89d9-1fe690669fb9" status: 200 len: 1576 microversion: 2.1 time: 0.742252 Jun 06 10:43:29.617129 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 315/611] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:43:28 2022] GET /compute/v2.1/servers/f835921f-5523-4063-89d9-1fe690669fb9 => generated 1576 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:43:29.992619 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-73e6c2bd-a001-4f58-acb8-f66e7e214f5a tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:43:29.993134 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-73e6c2bd-a001-4f58-acb8-f66e7e214f5a tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] [instance: 8e9cb9c1-7df9-4cb7-9121-54bf74f552c7] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:43:30.000310 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-73e6c2bd-a001-4f58-acb8-f66e7e214f5a tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:43:30.000760 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-73e6c2bd-a001-4f58-acb8-f66e7e214f5a tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:43:30.001533 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-73e6c2bd-a001-4f58-acb8-f66e7e214f5a tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:43:30.001966 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-73e6c2bd-a001-4f58-acb8-f66e7e214f5a tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:43:30.018100 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG dbcounter [-] [129350] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 10:43:30.030369 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-73e6c2bd-a001-4f58-acb8-f66e7e214f5a tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] [instance: 8e9cb9c1-7df9-4cb7-9121-54bf74f552c7] Going to try to terminate instance {{(pid=129350) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 06 10:43:30.113358 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-73e6c2bd-a001-4f58-acb8-f66e7e214f5a tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] 10.222.0.42 "DELETE /compute/v2.1/servers/8e9cb9c1-7df9-4cb7-9121-54bf74f552c7" status: 204 len: 0 microversion: 2.1 time: 0.124247 Jun 06 10:43:30.113979 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 297/612] 10.222.0.42 () {58 vars in 1238 bytes} [Mon Jun 6 10:43:29 2022] DELETE /compute/v2.1/servers/8e9cb9c1-7df9-4cb7-9121-54bf74f552c7 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 06 10:43:30.122303 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-dfefe075-1e4c-4b0c-9bd7-de71bb478b78 tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:43:30.124518 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-dfefe075-1e4c-4b0c-9bd7-de71bb478b78 tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] [instance: 8e9cb9c1-7df9-4cb7-9121-54bf74f552c7] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:43:30.139541 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-dfefe075-1e4c-4b0c-9bd7-de71bb478b78 tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:43:30.140316 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-dfefe075-1e4c-4b0c-9bd7-de71bb478b78 tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:43:30.141646 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-dfefe075-1e4c-4b0c-9bd7-de71bb478b78 tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:43:30.142277 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-dfefe075-1e4c-4b0c-9bd7-de71bb478b78 tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:43:30.225161 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-c3473b9e-a2ab-488f-8fab-1a85a9703739 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Action: 'create', calling method: .version_select at 0x7f8fd809a040>, body: {"keypair": {"name": "tempest-keypair-1033199175", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHAxLyTGM4Ptt4jHmbFQ80SHRhSPlBv4l9jVI/MVlJhJGoPSNZCokBT4r3ZidSlV9mWRy36WxmMNDj3rf6bKyrbd0No6eLvGoGz+/P4wwUkFk+aK/ypgr3YtvILah8+e1g=="}} {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 10:43:30.241060 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.quota [None req-c3473b9e-a2ab-488f-8fab-1a85a9703739 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Getting quotas for project 92244b4ae17d49bebe621e803bd9ae58. Resources: {'key_pairs'} {{(pid=129350) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 06 10:43:30.245205 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.quota [None req-c3473b9e-a2ab-488f-8fab-1a85a9703739 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Getting quotas for user 7ba341ea1ac34874bbfb8b2f713aea1b and project 92244b4ae17d49bebe621e803bd9ae58. Resources: {'key_pairs'} {{(pid=129350) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 06 10:43:30.270106 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-c3473b9e-a2ab-488f-8fab-1a85a9703739 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.101437 Jun 06 10:43:30.275822 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 298/613] 10.222.0.42 () {60 vars in 1158 bytes} [Mon Jun 6 10:43:30 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 06 10:43:30.321094 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-dfefe075-1e4c-4b0c-9bd7-de71bb478b78 tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7b11ed004fc4ef3a1f1c48adf31fe8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '645eadf589944a24bf6e27326a61952c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:43:30.329781 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-dfefe075-1e4c-4b0c-9bd7-de71bb478b78 tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] 10.222.0.42 "GET /compute/v2.1/servers/8e9cb9c1-7df9-4cb7-9121-54bf74f552c7" status: 200 len: 1554 microversion: 2.1 time: 0.211185 Jun 06 10:43:30.330622 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 316/614] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:43:30 2022] GET /compute/v2.1/servers/8e9cb9c1-7df9-4cb7-9121-54bf74f552c7 => generated 1554 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:43:30.635083 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-8870dcce-44bd-419a-96fd-544e2a63d07d tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:43:30.636129 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-8870dcce-44bd-419a-96fd-544e2a63d07d tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] [instance: f835921f-5523-4063-89d9-1fe690669fb9] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:43:30.643347 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-8870dcce-44bd-419a-96fd-544e2a63d07d tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:43:30.643816 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-8870dcce-44bd-419a-96fd-544e2a63d07d tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:43:30.644608 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-8870dcce-44bd-419a-96fd-544e2a63d07d tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:43:30.645046 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-8870dcce-44bd-419a-96fd-544e2a63d07d tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:43:30.799857 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-8870dcce-44bd-419a-96fd-544e2a63d07d tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d09fe912b4c4cab81b00df801f69680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2496096b374f399606bff9a08b65eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:43:30.814377 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-8870dcce-44bd-419a-96fd-544e2a63d07d tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] 10.222.0.42 "GET /compute/v2.1/servers/f835921f-5523-4063-89d9-1fe690669fb9" status: 200 len: 1576 microversion: 2.1 time: 0.183797 Jun 06 10:43:30.816085 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 299/615] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:43:30 2022] GET /compute/v2.1/servers/f835921f-5523-4063-89d9-1fe690669fb9 => generated 1576 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:43:31.348940 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-3d8758e9-f5f8-4cca-93d6-17d7f73544ed tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:43:31.349721 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-3d8758e9-f5f8-4cca-93d6-17d7f73544ed tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] [instance: 8e9cb9c1-7df9-4cb7-9121-54bf74f552c7] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:43:31.356966 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-3d8758e9-f5f8-4cca-93d6-17d7f73544ed tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:43:31.358299 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-3d8758e9-f5f8-4cca-93d6-17d7f73544ed tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:43:31.359308 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-3d8758e9-f5f8-4cca-93d6-17d7f73544ed tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:43:31.360242 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-3d8758e9-f5f8-4cca-93d6-17d7f73544ed tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:43:31.519070 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-3d8758e9-f5f8-4cca-93d6-17d7f73544ed tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7b11ed004fc4ef3a1f1c48adf31fe8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '645eadf589944a24bf6e27326a61952c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:43:31.526431 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-3d8758e9-f5f8-4cca-93d6-17d7f73544ed tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] 10.222.0.42 "GET /compute/v2.1/servers/8e9cb9c1-7df9-4cb7-9121-54bf74f552c7" status: 200 len: 1554 microversion: 2.1 time: 0.182544 Jun 06 10:43:31.527686 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 317/616] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:43:31 2022] GET /compute/v2.1/servers/8e9cb9c1-7df9-4cb7-9121-54bf74f552c7 => generated 1554 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:43:31.832659 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-2ff4c357-fc33-48f8-9ddb-b48781937694 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:43:31.833264 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-2ff4c357-fc33-48f8-9ddb-b48781937694 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] [instance: f835921f-5523-4063-89d9-1fe690669fb9] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:43:31.841566 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-2ff4c357-fc33-48f8-9ddb-b48781937694 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:43:31.842297 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-2ff4c357-fc33-48f8-9ddb-b48781937694 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:43:31.843146 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-2ff4c357-fc33-48f8-9ddb-b48781937694 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:43:31.843642 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-2ff4c357-fc33-48f8-9ddb-b48781937694 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:43:31.933810 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-45acfd78-31a4-416e-9fa4-8e4a69699ce5 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-278851587", "imageRef": "6eea2d98-354d-4083-b74c-abcbb97f9e1a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3bc95a68-dc60-40e7-808c-a65a4ba0072c"}], "security_groups": [{"name": "tempest-securitygroup--1320528089"}], "key_name": "tempest-keypair-1033199175", "user_data": "}} {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 10:43:32.030815 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-2ff4c357-fc33-48f8-9ddb-b48781937694 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d09fe912b4c4cab81b00df801f69680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2496096b374f399606bff9a08b65eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:43:32.039206 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-2ff4c357-fc33-48f8-9ddb-b48781937694 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] 10.222.0.42 "GET /compute/v2.1/servers/f835921f-5523-4063-89d9-1fe690669fb9" status: 200 len: 1576 microversion: 2.1 time: 0.210533 Jun 06 10:43:32.042723 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 300/617] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:43:31 2022] GET /compute/v2.1/servers/f835921f-5523-4063-89d9-1fe690669fb9 => generated 1576 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:43:32.064148 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.network.neutron [None req-45acfd78-31a4-416e-9fa4-8e4a69699ce5 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] validate_networks() for [('3bc95a68-dc60-40e7-808c-a65a4ba0072c', None, None, None, None, None)] {{(pid=129349) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 06 10:43:32.348443 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 06 10:43:32.348683 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: Mon Jun 6 10:43:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.42) !!! Jun 06 10:43:32.511846 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.virt.hardware [None req-45acfd78-31a4-416e-9fa4-8e4a69699ce5 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Flavor limits 0:0:0 {{(pid=129349) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 06 10:43:32.512476 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.virt.hardware [None req-45acfd78-31a4-416e-9fa4-8e4a69699ce5 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Image limits 0:0:0 {{(pid=129349) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 06 10:43:32.512910 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.virt.hardware [None req-45acfd78-31a4-416e-9fa4-8e4a69699ce5 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Flavor pref 0:0:0 {{(pid=129349) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 06 10:43:32.513926 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.virt.hardware [None req-45acfd78-31a4-416e-9fa4-8e4a69699ce5 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Image pref 0:0:0 {{(pid=129349) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 06 10:43:32.514379 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.virt.hardware [None req-45acfd78-31a4-416e-9fa4-8e4a69699ce5 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129349) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 06 10:43:32.524252 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-45acfd78-31a4-416e-9fa4-8e4a69699ce5 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:43:32.524697 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-45acfd78-31a4-416e-9fa4-8e4a69699ce5 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:43:32.525562 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-45acfd78-31a4-416e-9fa4-8e4a69699ce5 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:43:32.525948 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-45acfd78-31a4-416e-9fa4-8e4a69699ce5 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:43:32.543641 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-7cff4493-ae15-4443-bc99-5914dd692dec tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:43:32.544078 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.quota [None req-45acfd78-31a4-416e-9fa4-8e4a69699ce5 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Getting quotas for project 92244b4ae17d49bebe621e803bd9ae58. Resources: {'ram', 'cores', 'instances'} {{(pid=129349) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 06 10:43:32.544335 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-7cff4493-ae15-4443-bc99-5914dd692dec tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] [instance: 8e9cb9c1-7df9-4cb7-9121-54bf74f552c7] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:43:32.548981 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.quota [None req-45acfd78-31a4-416e-9fa4-8e4a69699ce5 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Getting quotas for user 7ba341ea1ac34874bbfb8b2f713aea1b and project 92244b4ae17d49bebe621e803bd9ae58. Resources: {'ram', 'cores', 'instances'} {{(pid=129349) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 06 10:43:32.550903 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-7cff4493-ae15-4443-bc99-5914dd692dec tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:43:32.551384 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-7cff4493-ae15-4443-bc99-5914dd692dec tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:43:32.552439 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-7cff4493-ae15-4443-bc99-5914dd692dec tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:43:32.552919 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-7cff4493-ae15-4443-bc99-5914dd692dec tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:43:32.566688 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-45acfd78-31a4-416e-9fa4-8e4a69699ce5 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Going to run 1 instances... {{(pid=129349) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 06 10:43:32.569013 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-45acfd78-31a4-416e-9fa4-8e4a69699ce5 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] [instance: 3827eb37-6346-4a31-a6e5-25b90628827c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6eea2d98-354d-4083-b74c-abcbb97f9e1a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129349) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 06 10:43:32.623651 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-45acfd78-31a4-416e-9fa4-8e4a69699ce5 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.708801 Jun 06 10:43:32.624608 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 318/618] 10.222.0.42 () {60 vars in 1146 bytes} [Mon Jun 6 10:43:31 2022] POST /compute/v2.1/servers => generated 402 bytes in 710 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 06 10:43:32.634443 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-4e5ad699-00c5-4876-bb10-a33444fe83b3 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:43:32.636535 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-4e5ad699-00c5-4876-bb10-a33444fe83b3 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] [instance: 3827eb37-6346-4a31-a6e5-25b90628827c] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:43:32.708844 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-4e5ad699-00c5-4876-bb10-a33444fe83b3 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ba341ea1ac34874bbfb8b2f713aea1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92244b4ae17d49bebe621e803bd9ae58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:43:32.716342 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-4e5ad699-00c5-4876-bb10-a33444fe83b3 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] 10.222.0.42 "GET /compute/v2.1/servers/3827eb37-6346-4a31-a6e5-25b90628827c" status: 200 len: 1241 microversion: 2.1 time: 0.085551 Jun 06 10:43:32.717695 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 319/619] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:43:32 2022] GET /compute/v2.1/servers/3827eb37-6346-4a31-a6e5-25b90628827c => generated 1241 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 10:43:32.790654 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-7cff4493-ae15-4443-bc99-5914dd692dec tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7b11ed004fc4ef3a1f1c48adf31fe8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '645eadf589944a24bf6e27326a61952c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:43:32.798773 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-7cff4493-ae15-4443-bc99-5914dd692dec tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] 10.222.0.42 "GET /compute/v2.1/servers/8e9cb9c1-7df9-4cb7-9121-54bf74f552c7" status: 200 len: 1554 microversion: 2.1 time: 0.259043 Jun 06 10:43:32.799744 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 301/620] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:43:32 2022] GET /compute/v2.1/servers/8e9cb9c1-7df9-4cb7-9121-54bf74f552c7 => generated 1554 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 10:43:33.058018 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-606e64d6-83f3-4f44-afc4-17bf5854c9d8 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:43:33.058666 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-606e64d6-83f3-4f44-afc4-17bf5854c9d8 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] [instance: f835921f-5523-4063-89d9-1fe690669fb9] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:43:33.067665 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-606e64d6-83f3-4f44-afc4-17bf5854c9d8 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:43:33.068455 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-606e64d6-83f3-4f44-afc4-17bf5854c9d8 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:43:33.069443 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-606e64d6-83f3-4f44-afc4-17bf5854c9d8 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:43:33.070058 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-606e64d6-83f3-4f44-afc4-17bf5854c9d8 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:43:33.317713 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-606e64d6-83f3-4f44-afc4-17bf5854c9d8 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d09fe912b4c4cab81b00df801f69680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2496096b374f399606bff9a08b65eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:43:33.328080 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-606e64d6-83f3-4f44-afc4-17bf5854c9d8 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] 10.222.0.42 "GET /compute/v2.1/servers/f835921f-5523-4063-89d9-1fe690669fb9" status: 200 len: 1576 microversion: 2.1 time: 0.272672 Jun 06 10:43:33.328807 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 320/621] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:43:33 2022] GET /compute/v2.1/servers/f835921f-5523-4063-89d9-1fe690669fb9 => generated 1576 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:43:33.376773 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [req-c02cf9d2-70c0-49a8-adb7-7a1d62d108ce req-9c0b68f3-a5aa-4544-a041-72324757d334 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e9cb9c1-7df9-4cb7-9121-54bf74f552c7", "name": "network-vif-deleted", "tag": "d50634ea-b30b-4bd6-b547-ee82d39a4a57"}]} {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 10:43:33.387692 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [req-c02cf9d2-70c0-49a8-adb7-7a1d62d108ce req-9c0b68f3-a5aa-4544-a041-72324757d334 service nova] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:43:33.388210 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [req-c02cf9d2-70c0-49a8-adb7-7a1d62d108ce req-9c0b68f3-a5aa-4544-a041-72324757d334 service nova] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:43:33.400585 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.compute.server_external_events [req-c02cf9d2-70c0-49a8-adb7-7a1d62d108ce req-9c0b68f3-a5aa-4544-a041-72324757d334 service nova] Creating event network-vif-deleted:d50634ea-b30b-4bd6-b547-ee82d39a4a57 for instance 8e9cb9c1-7df9-4cb7-9121-54bf74f552c7 on hv-cinder-84482 Jun 06 10:43:33.406321 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [req-c02cf9d2-70c0-49a8-adb7-7a1d62d108ce req-9c0b68f3-a5aa-4544-a041-72324757d334 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035226 Jun 06 10:43:33.407036 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 302/622] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Jun 6 10:43:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 10:43:33.585135 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-e7153c9c-c38c-4ad3-b691-a1ec1705e36c tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:43:33.585637 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-e7153c9c-c38c-4ad3-b691-a1ec1705e36c tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] [instance: ce3b66f8-03e9-4d5f-8c40-d1a887b12304] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:43:33.591689 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-e7153c9c-c38c-4ad3-b691-a1ec1705e36c tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:43:33.592175 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-e7153c9c-c38c-4ad3-b691-a1ec1705e36c tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:43:33.592983 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-e7153c9c-c38c-4ad3-b691-a1ec1705e36c tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:43:33.593469 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-e7153c9c-c38c-4ad3-b691-a1ec1705e36c tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:43:33.617778 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-e7153c9c-c38c-4ad3-b691-a1ec1705e36c tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] 10.222.0.42 "GET /compute/v2.1/servers/ce3b66f8-03e9-4d5f-8c40-d1a887b12304/ips" status: 200 len: 150 microversion: 2.20 time: 0.152558 Jun 06 10:43:33.618356 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 321/623] 10.222.0.42 () {60 vars in 1288 bytes} [Mon Jun 6 10:43:33 2022] GET /compute/v2.1/servers/ce3b66f8-03e9-4d5f-8c40-d1a887b12304/ips => generated 150 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 06 10:43:33.737717 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-49b12e84-788c-4015-a769-8fdcb232124f tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:43:33.738452 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-49b12e84-788c-4015-a769-8fdcb232124f tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] [instance: 3827eb37-6346-4a31-a6e5-25b90628827c] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:43:33.747051 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-49b12e84-788c-4015-a769-8fdcb232124f tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:43:33.748727 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-49b12e84-788c-4015-a769-8fdcb232124f tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:43:33.749616 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-49b12e84-788c-4015-a769-8fdcb232124f tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:43:33.750363 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-49b12e84-788c-4015-a769-8fdcb232124f tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:43:33.816787 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-8674bfc3-6867-43df-8506-faaf89a8321f tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:43:33.817493 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-8674bfc3-6867-43df-8506-faaf89a8321f tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] [instance: 8e9cb9c1-7df9-4cb7-9121-54bf74f552c7] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:43:33.828059 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-8674bfc3-6867-43df-8506-faaf89a8321f tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:43:33.828527 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-8674bfc3-6867-43df-8506-faaf89a8321f tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:43:33.829334 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-8674bfc3-6867-43df-8506-faaf89a8321f tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:43:33.829814 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-8674bfc3-6867-43df-8506-faaf89a8321f tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:43:33.877615 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-8674bfc3-6867-43df-8506-faaf89a8321f tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:43:33.878056 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-8674bfc3-6867-43df-8506-faaf89a8321f tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:43:33.878736 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.objects.instance [None req-8674bfc3-6867-43df-8506-faaf89a8321f tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Lazy-loading 'fault' on Instance uuid 8e9cb9c1-7df9-4cb7-9121-54bf74f552c7 {{(pid=129349) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 06 10:43:33.886102 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-49b12e84-788c-4015-a769-8fdcb232124f tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ba341ea1ac34874bbfb8b2f713aea1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92244b4ae17d49bebe621e803bd9ae58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:43:33.898470 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-49b12e84-788c-4015-a769-8fdcb232124f tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] 10.222.0.42 "GET /compute/v2.1/servers/3827eb37-6346-4a31-a6e5-25b90628827c" status: 200 len: 1301 microversion: 2.1 time: 0.165854 Jun 06 10:43:33.899950 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 303/624] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:43:33 2022] GET /compute/v2.1/servers/3827eb37-6346-4a31-a6e5-25b90628827c => generated 1301 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:43:33.930128 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-8674bfc3-6867-43df-8506-faaf89a8321f tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7b11ed004fc4ef3a1f1c48adf31fe8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '645eadf589944a24bf6e27326a61952c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:43:33.938796 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-8674bfc3-6867-43df-8506-faaf89a8321f tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] 10.222.0.42 "GET /compute/v2.1/servers/8e9cb9c1-7df9-4cb7-9121-54bf74f552c7" status: 200 len: 1347 microversion: 2.1 time: 0.126075 Jun 06 10:43:33.952701 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 322/625] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:43:33 2022] GET /compute/v2.1/servers/8e9cb9c1-7df9-4cb7-9121-54bf74f552c7 => generated 1347 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:43:34.345223 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-68a2eb22-b58f-46dd-92c4-4822a6dc3a10 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:43:34.345748 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-68a2eb22-b58f-46dd-92c4-4822a6dc3a10 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] [instance: f835921f-5523-4063-89d9-1fe690669fb9] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:43:34.351924 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-68a2eb22-b58f-46dd-92c4-4822a6dc3a10 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:43:34.352625 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-68a2eb22-b58f-46dd-92c4-4822a6dc3a10 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:43:34.353392 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-68a2eb22-b58f-46dd-92c4-4822a6dc3a10 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:43:34.353826 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-68a2eb22-b58f-46dd-92c4-4822a6dc3a10 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:43:34.579322 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-68a2eb22-b58f-46dd-92c4-4822a6dc3a10 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d09fe912b4c4cab81b00df801f69680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2496096b374f399606bff9a08b65eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:43:34.593741 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-68a2eb22-b58f-46dd-92c4-4822a6dc3a10 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] 10.222.0.42 "GET /compute/v2.1/servers/f835921f-5523-4063-89d9-1fe690669fb9" status: 200 len: 1576 microversion: 2.1 time: 0.252725 Jun 06 10:43:34.594324 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 304/626] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:43:34 2022] GET /compute/v2.1/servers/f835921f-5523-4063-89d9-1fe690669fb9 => generated 1576 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:43:34.917219 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-818322f8-5bc4-4fcf-9333-d9679d12da99 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:43:34.918456 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-818322f8-5bc4-4fcf-9333-d9679d12da99 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] [instance: 3827eb37-6346-4a31-a6e5-25b90628827c] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:43:34.925581 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-818322f8-5bc4-4fcf-9333-d9679d12da99 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:43:34.926027 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-818322f8-5bc4-4fcf-9333-d9679d12da99 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:43:34.926854 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-818322f8-5bc4-4fcf-9333-d9679d12da99 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:43:34.927291 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-818322f8-5bc4-4fcf-9333-d9679d12da99 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:43:34.956934 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-8adba5b6-a19c-45cf-8066-b0907db250d3 tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:43:34.957949 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-8adba5b6-a19c-45cf-8066-b0907db250d3 tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] [instance: 8e9cb9c1-7df9-4cb7-9121-54bf74f552c7] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:43:34.965712 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-8adba5b6-a19c-45cf-8066-b0907db250d3 tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:43:34.966379 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-8adba5b6-a19c-45cf-8066-b0907db250d3 tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:43:34.967235 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-8adba5b6-a19c-45cf-8066-b0907db250d3 tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:43:34.967674 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-8adba5b6-a19c-45cf-8066-b0907db250d3 tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:43:34.981462 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.wsgi [None req-8adba5b6-a19c-45cf-8066-b0907db250d3 tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] HTTP exception thrown: Instance 8e9cb9c1-7df9-4cb7-9121-54bf74f552c7 could not be found. Jun 06 10:43:34.983187 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-8adba5b6-a19c-45cf-8066-b0907db250d3 tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Request method failure captured: Jun 06 10:43:34.983187 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: request: GET /compute/v2.1/servers/8e9cb9c1-7df9-4cb7-9121-54bf74f552c7 HTTP/1.1 Jun 06 10:43:34.983187 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: Accept: application/json Jun 06 10:43:34.983187 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: Accept-Encoding: identity Jun 06 10:43:34.983187 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: Connection: close Jun 06 10:43:34.983187 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: Content-Length: 0 Jun 06 10:43:34.983187 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: Content-Type: application/json Jun 06 10:43:34.983187 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: Host: 10.222.0.42 Jun 06 10:43:34.983187 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: Openstack-System-Scope: None Jun 06 10:43:34.983187 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: User-Agent: python-urllib3/1.26.9 Jun 06 10:43:34.983187 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Auth-Token: gAAAAABindm_dbdArPoNUnqh6OhCbAX2OJyd6n9DFL28BFZ3Z6cDWWjnluFo0I4bpJXOWlgFVdvl3mmxLv5ttGrqKu1iECpLAm6E8CjPCETHejCa3vLYlEGmXT9k-P7GsEdRYvVCfpEopic3tP5VRunoZgDp9ew3XrymioYjCGA9AzSR_TM_4Sk Jun 06 10:43:34.983187 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Domain-Id: None Jun 06 10:43:34.983187 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Domain-Name: None Jun 06 10:43:34.983187 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Identity-Status: Confirmed Jun 06 10:43:34.983187 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Is-Admin-Project: True Jun 06 10:43:34.983187 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Project-Domain-Id: default Jun 06 10:43:34.983187 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Project-Domain-Name: Default Jun 06 10:43:34.983187 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Project-Id: 645eadf589944a24bf6e27326a61952c Jun 06 10:43:34.983187 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Project-Name: tempest-TestMinimumBasicScenario-1630290687 Jun 06 10:43:34.983187 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Role: member,reader Jun 06 10:43:34.983187 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Roles: member,reader Jun 06 10:43:34.984728 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/645eadf589944a24bf6e27326a61952c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/645eadf589944a24bf6e27326a61952c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/645eadf589944a24bf6e27326a61952c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_645eadf589944a24bf6e27326a61952c", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Jun 06 10:43:34.984728 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Tenant: tempest-TestMinimumBasicScenario-1630290687 Jun 06 10:43:34.984728 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Tenant-Id: 645eadf589944a24bf6e27326a61952c Jun 06 10:43:34.984728 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1630290687 Jun 06 10:43:34.984728 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-User: tempest-TestMinimumBasicScenario-1630290687-project Jun 06 10:43:34.984728 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-User-Domain-Id: default Jun 06 10:43:34.984728 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-User-Domain-Name: Default Jun 06 10:43:34.984728 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-User-Id: b7b11ed004fc4ef3a1f1c48adf31fe8e Jun 06 10:43:34.984728 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-User-Name: tempest-TestMinimumBasicScenario-1630290687-project Jun 06 10:43:34.984728 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: method: > Jun 06 10:43:34.984728 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: exception: Instance 8e9cb9c1-7df9-4cb7-9121-54bf74f552c7 could not be found. Jun 06 10:43:34.984728 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: action_args: {'id': '8e9cb9c1-7df9-4cb7-9121-54bf74f552c7'} Jun 06 10:43:34.985612 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 10:43:34.985612 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 10:43:34.985612 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 06 10:43:34.985612 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 06 10:43:34.985612 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 06 10:43:34.985612 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 06 10:43:34.985612 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 06 10:43:34.985612 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 06 10:43:34.985612 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 06 10:43:34.985612 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 06 10:43:34.985612 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8e9cb9c1-7df9-4cb7-9121-54bf74f552c7 could not be found. Jun 06 10:43:34.985612 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi Jun 06 10:43:34.985612 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 10:43:34.985612 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi Jun 06 10:43:34.985612 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 10:43:34.985612 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 10:43:34.985612 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 10:43:34.985612 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 10:43:34.985612 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 10:43:34.985612 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 10:43:34.986840 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 10:43:34.986840 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 06 10:43:34.986840 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 06 10:43:34.986840 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 06 10:43:34.986840 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 06 10:43:34.986840 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 06 10:43:34.986840 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 06 10:43:34.986840 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8e9cb9c1-7df9-4cb7-9121-54bf74f552c7 could not be found. Jun 06 10:43:34.986840 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi Jun 06 10:43:34.986840 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 10:43:34.986840 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi Jun 06 10:43:34.986840 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 10:43:34.986840 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 10:43:34.986840 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 10:43:34.986840 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 10:43:34.986840 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 10:43:34.986840 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8e9cb9c1-7df9-4cb7-9121-54bf74f552c7 could not be found. Jun 06 10:43:34.986840 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi Jun 06 10:43:34.987909 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-8adba5b6-a19c-45cf-8066-b0907db250d3 tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Returning 404 to user: Instance 8e9cb9c1-7df9-4cb7-9121-54bf74f552c7 could not be found. {{(pid=129350) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 10:43:34.987909 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-8adba5b6-a19c-45cf-8066-b0907db250d3 tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] 10.222.0.42 "GET /compute/v2.1/servers/8e9cb9c1-7df9-4cb7-9121-54bf74f552c7" status: 404 len: 111 microversion: 2.1 time: 0.031692 Jun 06 10:43:34.988402 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 305/627] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:43:34 2022] GET /compute/v2.1/servers/8e9cb9c1-7df9-4cb7-9121-54bf74f552c7 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 06 10:43:34.993157 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-3ca3dc2e-4863-4d87-aee6-cda0967f014f tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] Calling method '.version_select at 0x7f8fd80579d0>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:43:35.012558 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-3ca3dc2e-4863-4d87-aee6-cda0967f014f tempest-TestMinimumBasicScenario-1630290687 tempest-TestMinimumBasicScenario-1630290687-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-879768701" status: 202 len: 0 microversion: 2.1 time: 0.023084 Jun 06 10:43:35.013789 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 306/628] 10.222.0.42 () {58 vars in 1268 bytes} [Mon Jun 6 10:43:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-879768701 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 06 10:43:35.175202 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-818322f8-5bc4-4fcf-9333-d9679d12da99 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ba341ea1ac34874bbfb8b2f713aea1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92244b4ae17d49bebe621e803bd9ae58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:43:35.184554 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-818322f8-5bc4-4fcf-9333-d9679d12da99 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] 10.222.0.42 "GET /compute/v2.1/servers/3827eb37-6346-4a31-a6e5-25b90628827c" status: 200 len: 1367 microversion: 2.1 time: 0.271724 Jun 06 10:43:35.185919 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 323/629] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:43:34 2022] GET /compute/v2.1/servers/3827eb37-6346-4a31-a6e5-25b90628827c => generated 1367 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:43:35.574231 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [req-7b823d05-fd47-4608-9881-56d50c511a3e req-04c18bff-17d3-4b63-a47e-c4866705def5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3827eb37-6346-4a31-a6e5-25b90628827c", "tag": "db231a6f-2db0-4cdc-851e-c9e6ca043bb0"}]} {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 10:43:35.585970 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [req-7b823d05-fd47-4608-9881-56d50c511a3e req-04c18bff-17d3-4b63-a47e-c4866705def5 service nova] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:43:35.586803 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [req-7b823d05-fd47-4608-9881-56d50c511a3e req-04c18bff-17d3-4b63-a47e-c4866705def5 service nova] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:43:35.607741 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.compute.server_external_events [req-7b823d05-fd47-4608-9881-56d50c511a3e req-04c18bff-17d3-4b63-a47e-c4866705def5 service nova] Creating event network-changed:db231a6f-2db0-4cdc-851e-c9e6ca043bb0 for instance 3827eb37-6346-4a31-a6e5-25b90628827c on hv-cinder-84482 Jun 06 10:43:35.615052 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [req-7b823d05-fd47-4608-9881-56d50c511a3e req-04c18bff-17d3-4b63-a47e-c4866705def5 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045596 Jun 06 10:43:35.616613 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-67522771-586d-45c0-83ec-41371c212871 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:43:35.619041 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-67522771-586d-45c0-83ec-41371c212871 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] [instance: f835921f-5523-4063-89d9-1fe690669fb9] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:43:35.619338 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 307/630] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Jun 6 10:43:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 10:43:35.630310 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-67522771-586d-45c0-83ec-41371c212871 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:43:35.630980 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-67522771-586d-45c0-83ec-41371c212871 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:43:35.631928 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-67522771-586d-45c0-83ec-41371c212871 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:43:35.632440 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-67522771-586d-45c0-83ec-41371c212871 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:43:35.862714 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-67522771-586d-45c0-83ec-41371c212871 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d09fe912b4c4cab81b00df801f69680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2496096b374f399606bff9a08b65eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:43:35.870417 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-67522771-586d-45c0-83ec-41371c212871 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] 10.222.0.42 "GET /compute/v2.1/servers/f835921f-5523-4063-89d9-1fe690669fb9" status: 200 len: 1576 microversion: 2.1 time: 0.262414 Jun 06 10:43:35.871995 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 324/631] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:43:35 2022] GET /compute/v2.1/servers/f835921f-5523-4063-89d9-1fe690669fb9 => generated 1576 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:43:36.030252 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-ef8dd233-95fa-4305-9d0b-ce1f9577638f tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 10:43:36.030873 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-ef8dd233-95fa-4305-9d0b-ce1f9577638f tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] [instance: ce3b66f8-03e9-4d5f-8c40-d1a887b12304] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:43:36.037031 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-ef8dd233-95fa-4305-9d0b-ce1f9577638f tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:43:36.037484 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-ef8dd233-95fa-4305-9d0b-ce1f9577638f tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:43:36.038248 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-ef8dd233-95fa-4305-9d0b-ce1f9577638f tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:43:36.040463 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-ef8dd233-95fa-4305-9d0b-ce1f9577638f tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:43:36.065232 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.objects.instance [None req-ef8dd233-95fa-4305-9d0b-ce1f9577638f tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lazy-loading 'flavor' on Instance uuid ce3b66f8-03e9-4d5f-8c40-d1a887b12304 {{(pid=129350) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 06 10:43:36.202932 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-bbaac269-8eeb-447c-81e5-5054e77e2b4e tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:43:36.203658 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-bbaac269-8eeb-447c-81e5-5054e77e2b4e tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] [instance: 3827eb37-6346-4a31-a6e5-25b90628827c] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:43:36.209650 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-bbaac269-8eeb-447c-81e5-5054e77e2b4e tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:43:36.210088 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-bbaac269-8eeb-447c-81e5-5054e77e2b4e tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:43:36.210850 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-bbaac269-8eeb-447c-81e5-5054e77e2b4e tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:43:36.211282 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-bbaac269-8eeb-447c-81e5-5054e77e2b4e tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:43:36.381341 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-ef8dd233-95fa-4305-9d0b-ce1f9577638f tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] 10.222.0.42 "POST /compute/v2.1/servers/ce3b66f8-03e9-4d5f-8c40-d1a887b12304/action" status: 202 len: 0 microversion: 2.20 time: 0.356493 Jun 06 10:43:36.383195 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 308/632] 10.222.0.42 () {62 vars in 1318 bytes} [Mon Jun 6 10:43:36 2022] POST /compute/v2.1/servers/ce3b66f8-03e9-4d5f-8c40-d1a887b12304/action => generated 0 bytes in 359 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 06 10:43:36.399934 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-bbaac269-8eeb-447c-81e5-5054e77e2b4e tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ba341ea1ac34874bbfb8b2f713aea1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92244b4ae17d49bebe621e803bd9ae58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:43:36.409477 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-bbaac269-8eeb-447c-81e5-5054e77e2b4e tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] 10.222.0.42 "GET /compute/v2.1/servers/3827eb37-6346-4a31-a6e5-25b90628827c" status: 200 len: 1367 microversion: 2.1 time: 0.210835 Jun 06 10:43:36.410355 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 325/633] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:43:36 2022] GET /compute/v2.1/servers/3827eb37-6346-4a31-a6e5-25b90628827c => generated 1367 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:43:36.415277 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-6e9b6573-818e-4fd6-a99f-8a3f7044cf8e tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:43:36.416158 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-6e9b6573-818e-4fd6-a99f-8a3f7044cf8e tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] [instance: ce3b66f8-03e9-4d5f-8c40-d1a887b12304] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:43:36.422919 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-6e9b6573-818e-4fd6-a99f-8a3f7044cf8e tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:43:36.423412 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-6e9b6573-818e-4fd6-a99f-8a3f7044cf8e tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:43:36.424282 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-6e9b6573-818e-4fd6-a99f-8a3f7044cf8e tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:43:36.424741 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-6e9b6573-818e-4fd6-a99f-8a3f7044cf8e tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:43:36.460313 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [req-d720d1da-b9d4-4368-b0c4-dee7f3f6392e req-c3bb9dc0-2767-441a-8b4c-8928d5a30da6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f835921f-5523-4063-89d9-1fe690669fb9", "name": "network-vif-plugged", "status": "completed", "tag": "3a3a5f7d-eb2a-4a67-83a6-a0deab7b7e1a"}]} {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 10:43:36.469605 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [req-d720d1da-b9d4-4368-b0c4-dee7f3f6392e req-c3bb9dc0-2767-441a-8b4c-8928d5a30da6 service nova] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:43:36.470327 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [req-d720d1da-b9d4-4368-b0c4-dee7f3f6392e req-c3bb9dc0-2767-441a-8b4c-8928d5a30da6 service nova] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:43:36.482381 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.compute.server_external_events [req-d720d1da-b9d4-4368-b0c4-dee7f3f6392e req-c3bb9dc0-2767-441a-8b4c-8928d5a30da6 service nova] Creating event network-vif-plugged:3a3a5f7d-eb2a-4a67-83a6-a0deab7b7e1a for instance f835921f-5523-4063-89d9-1fe690669fb9 on hv-cinder-84482 Jun 06 10:43:36.487708 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [req-d720d1da-b9d4-4368-b0c4-dee7f3f6392e req-c3bb9dc0-2767-441a-8b4c-8928d5a30da6 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103022 Jun 06 10:43:36.488598 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 309/634] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Jun 6 10:43:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 10:43:36.563587 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-6e9b6573-818e-4fd6-a99f-8a3f7044cf8e tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:43:36.572135 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-6e9b6573-818e-4fd6-a99f-8a3f7044cf8e tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:43:36.573688 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-6e9b6573-818e-4fd6-a99f-8a3f7044cf8e tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:43:36.574916 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-6e9b6573-818e-4fd6-a99f-8a3f7044cf8e tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] 10.222.0.42 "GET /compute/v2.1/servers/ce3b66f8-03e9-4d5f-8c40-d1a887b12304" status: 200 len: 1721 microversion: 2.20 time: 0.163288 Jun 06 10:43:36.575665 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 326/635] 10.222.0.42 () {60 vars in 1276 bytes} [Mon Jun 6 10:43:36 2022] GET /compute/v2.1/servers/ce3b66f8-03e9-4d5f-8c40-d1a887b12304 => generated 1721 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 10:43:36.893338 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-0acc7618-7e37-4527-955b-fcfe0017d4a6 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:43:36.895563 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-0acc7618-7e37-4527-955b-fcfe0017d4a6 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] [instance: f835921f-5523-4063-89d9-1fe690669fb9] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:43:36.904905 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-0acc7618-7e37-4527-955b-fcfe0017d4a6 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:43:36.905679 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-0acc7618-7e37-4527-955b-fcfe0017d4a6 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:43:36.906643 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-0acc7618-7e37-4527-955b-fcfe0017d4a6 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:43:36.907260 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-0acc7618-7e37-4527-955b-fcfe0017d4a6 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:43:37.123869 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-0acc7618-7e37-4527-955b-fcfe0017d4a6 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d09fe912b4c4cab81b00df801f69680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2496096b374f399606bff9a08b65eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:43:37.131662 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-0acc7618-7e37-4527-955b-fcfe0017d4a6 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] 10.222.0.42 "GET /compute/v2.1/servers/f835921f-5523-4063-89d9-1fe690669fb9" status: 200 len: 1576 microversion: 2.1 time: 0.246013 Jun 06 10:43:37.132363 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 310/636] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:43:36 2022] GET /compute/v2.1/servers/f835921f-5523-4063-89d9-1fe690669fb9 => generated 1576 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:43:37.426597 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-9b476ac2-62b1-46d7-a449-6f561b7af581 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:43:37.428883 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-9b476ac2-62b1-46d7-a449-6f561b7af581 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] [instance: 3827eb37-6346-4a31-a6e5-25b90628827c] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:43:37.444967 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-9b476ac2-62b1-46d7-a449-6f561b7af581 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:43:37.445750 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-9b476ac2-62b1-46d7-a449-6f561b7af581 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:43:37.446764 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-9b476ac2-62b1-46d7-a449-6f561b7af581 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:43:37.447990 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-9b476ac2-62b1-46d7-a449-6f561b7af581 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:43:37.595885 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-b45a13f0-b019-496d-a6c5-5e63ad941dc3 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:43:37.596668 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-b45a13f0-b019-496d-a6c5-5e63ad941dc3 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] [instance: ce3b66f8-03e9-4d5f-8c40-d1a887b12304] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:43:37.603185 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-b45a13f0-b019-496d-a6c5-5e63ad941dc3 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:43:37.603640 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-b45a13f0-b019-496d-a6c5-5e63ad941dc3 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:43:37.604474 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-b45a13f0-b019-496d-a6c5-5e63ad941dc3 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:43:37.605212 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-b45a13f0-b019-496d-a6c5-5e63ad941dc3 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:43:37.953885 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-9b476ac2-62b1-46d7-a449-6f561b7af581 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ba341ea1ac34874bbfb8b2f713aea1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92244b4ae17d49bebe621e803bd9ae58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:43:37.965278 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-b45a13f0-b019-496d-a6c5-5e63ad941dc3 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:43:37.969433 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-9b476ac2-62b1-46d7-a449-6f561b7af581 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] 10.222.0.42 "GET /compute/v2.1/servers/3827eb37-6346-4a31-a6e5-25b90628827c" status: 200 len: 1367 microversion: 2.1 time: 0.546630 Jun 06 10:43:37.980355 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 327/637] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:43:37 2022] GET /compute/v2.1/servers/3827eb37-6346-4a31-a6e5-25b90628827c => generated 1367 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:43:37.986989 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-b45a13f0-b019-496d-a6c5-5e63ad941dc3 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:43:37.988926 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-b45a13f0-b019-496d-a6c5-5e63ad941dc3 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:43:37.990115 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-b45a13f0-b019-496d-a6c5-5e63ad941dc3 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] 10.222.0.42 "GET /compute/v2.1/servers/ce3b66f8-03e9-4d5f-8c40-d1a887b12304" status: 200 len: 1721 microversion: 2.20 time: 0.399276 Jun 06 10:43:37.991104 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 311/638] 10.222.0.42 () {60 vars in 1276 bytes} [Mon Jun 6 10:43:37 2022] GET /compute/v2.1/servers/ce3b66f8-03e9-4d5f-8c40-d1a887b12304 => generated 1721 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 06 10:43:38.148575 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-b01a67b4-7af7-4db7-9481-3280be83c62c tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:43:38.149466 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-b01a67b4-7af7-4db7-9481-3280be83c62c tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] [instance: f835921f-5523-4063-89d9-1fe690669fb9] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:43:38.158943 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-b01a67b4-7af7-4db7-9481-3280be83c62c tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:43:38.159471 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-b01a67b4-7af7-4db7-9481-3280be83c62c tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:43:38.160463 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-b01a67b4-7af7-4db7-9481-3280be83c62c tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:43:38.160968 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-b01a67b4-7af7-4db7-9481-3280be83c62c tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:43:38.165224 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG dbcounter [-] [129349] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=129349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 10:43:38.429545 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-b01a67b4-7af7-4db7-9481-3280be83c62c tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d09fe912b4c4cab81b00df801f69680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2496096b374f399606bff9a08b65eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:43:38.440316 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-b01a67b4-7af7-4db7-9481-3280be83c62c tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] 10.222.0.42 "GET /compute/v2.1/servers/f835921f-5523-4063-89d9-1fe690669fb9" status: 200 len: 1576 microversion: 2.1 time: 0.295659 Jun 06 10:43:38.440895 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 328/639] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:43:38 2022] GET /compute/v2.1/servers/f835921f-5523-4063-89d9-1fe690669fb9 => generated 1576 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:43:38.990762 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-90e10c33-3c81-4b04-963a-7a62d7fc7434 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:43:38.991367 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-90e10c33-3c81-4b04-963a-7a62d7fc7434 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] [instance: 3827eb37-6346-4a31-a6e5-25b90628827c] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:43:38.994519 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG dbcounter [-] [129350] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=2,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=129350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 10:43:39.001128 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-90e10c33-3c81-4b04-963a-7a62d7fc7434 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:43:39.001638 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-90e10c33-3c81-4b04-963a-7a62d7fc7434 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:43:39.003110 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-90e10c33-3c81-4b04-963a-7a62d7fc7434 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:43:39.009018 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-45cc5a84-aec1-4920-abe2-6609bc1b7dfa tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:43:39.009981 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-45cc5a84-aec1-4920-abe2-6609bc1b7dfa tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] [instance: ce3b66f8-03e9-4d5f-8c40-d1a887b12304] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:43:39.012397 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG dbcounter [-] [129349] Writing DB stats nova_api:SELECT=86,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=129349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 10:43:39.014821 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-90e10c33-3c81-4b04-963a-7a62d7fc7434 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:43:39.027063 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-45cc5a84-aec1-4920-abe2-6609bc1b7dfa tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:43:39.028209 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-45cc5a84-aec1-4920-abe2-6609bc1b7dfa tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:43:39.029823 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-45cc5a84-aec1-4920-abe2-6609bc1b7dfa tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:43:39.030309 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-45cc5a84-aec1-4920-abe2-6609bc1b7dfa tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:43:39.392124 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-45cc5a84-aec1-4920-abe2-6609bc1b7dfa tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:43:39.400215 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-45cc5a84-aec1-4920-abe2-6609bc1b7dfa tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:43:39.401736 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-45cc5a84-aec1-4920-abe2-6609bc1b7dfa tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:43:39.402427 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-90e10c33-3c81-4b04-963a-7a62d7fc7434 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ba341ea1ac34874bbfb8b2f713aea1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92244b4ae17d49bebe621e803bd9ae58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:43:39.402906 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-45cc5a84-aec1-4920-abe2-6609bc1b7dfa tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] 10.222.0.42 "GET /compute/v2.1/servers/ce3b66f8-03e9-4d5f-8c40-d1a887b12304" status: 200 len: 1721 microversion: 2.20 time: 0.397791 Jun 06 10:43:39.411233 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-90e10c33-3c81-4b04-963a-7a62d7fc7434 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] 10.222.0.42 "GET /compute/v2.1/servers/3827eb37-6346-4a31-a6e5-25b90628827c" status: 200 len: 1367 microversion: 2.1 time: 0.424285 Jun 06 10:43:39.411925 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 329/640] 10.222.0.42 () {60 vars in 1276 bytes} [Mon Jun 6 10:43:39 2022] GET /compute/v2.1/servers/ce3b66f8-03e9-4d5f-8c40-d1a887b12304 => generated 1721 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 10:43:39.419914 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 312/641] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:43:38 2022] GET /compute/v2.1/servers/3827eb37-6346-4a31-a6e5-25b90628827c => generated 1367 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:43:39.457333 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-4d203121-502a-42f6-aafe-92710477e98a tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:43:39.457948 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-4d203121-502a-42f6-aafe-92710477e98a tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] [instance: f835921f-5523-4063-89d9-1fe690669fb9] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:43:39.464012 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-4d203121-502a-42f6-aafe-92710477e98a tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:43:39.464473 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-4d203121-502a-42f6-aafe-92710477e98a tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:43:39.465246 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-4d203121-502a-42f6-aafe-92710477e98a tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:43:39.465676 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-4d203121-502a-42f6-aafe-92710477e98a tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:43:39.613808 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-4d203121-502a-42f6-aafe-92710477e98a tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d09fe912b4c4cab81b00df801f69680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2496096b374f399606bff9a08b65eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:43:39.621298 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-4d203121-502a-42f6-aafe-92710477e98a tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] 10.222.0.42 "GET /compute/v2.1/servers/f835921f-5523-4063-89d9-1fe690669fb9" status: 200 len: 1563 microversion: 2.1 time: 0.167912 Jun 06 10:43:39.621860 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 330/642] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:43:39 2022] GET /compute/v2.1/servers/f835921f-5523-4063-89d9-1fe690669fb9 => generated 1563 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:43:40.234779 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [req-d41bbc79-a0ca-48a7-82c2-e2b12621ec5c req-06548b0f-50aa-44e6-9cec-54a691332f76 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3827eb37-6346-4a31-a6e5-25b90628827c", "name": "network-vif-plugged", "status": "completed", "tag": "db231a6f-2db0-4cdc-851e-c9e6ca043bb0"}]} {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 10:43:40.244095 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [req-d41bbc79-a0ca-48a7-82c2-e2b12621ec5c req-06548b0f-50aa-44e6-9cec-54a691332f76 service nova] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:43:40.244693 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [req-d41bbc79-a0ca-48a7-82c2-e2b12621ec5c req-06548b0f-50aa-44e6-9cec-54a691332f76 service nova] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:43:40.256069 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG dbcounter [-] [129350] Writing DB stats nova_cell0:SELECT=4 {{(pid=129350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 10:43:40.259148 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.compute.server_external_events [req-d41bbc79-a0ca-48a7-82c2-e2b12621ec5c req-06548b0f-50aa-44e6-9cec-54a691332f76 service nova] Creating event network-vif-plugged:db231a6f-2db0-4cdc-851e-c9e6ca043bb0 for instance 3827eb37-6346-4a31-a6e5-25b90628827c on hv-cinder-84482 Jun 06 10:43:40.265126 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [req-d41bbc79-a0ca-48a7-82c2-e2b12621ec5c req-06548b0f-50aa-44e6-9cec-54a691332f76 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034425 Jun 06 10:43:40.265998 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 313/643] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Jun 6 10:43:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 10:43:40.429407 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-d938e11c-7977-414f-a373-2669a6f058e3 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:43:40.429929 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-0aa8deb6-ce82-46ed-929f-4e2caee2aef1 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:43:40.430883 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-0aa8deb6-ce82-46ed-929f-4e2caee2aef1 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] [instance: ce3b66f8-03e9-4d5f-8c40-d1a887b12304] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:43:40.431869 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-d938e11c-7977-414f-a373-2669a6f058e3 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] [instance: 3827eb37-6346-4a31-a6e5-25b90628827c] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:43:40.444330 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-d938e11c-7977-414f-a373-2669a6f058e3 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:43:40.448835 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-d938e11c-7977-414f-a373-2669a6f058e3 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:43:40.449231 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-0aa8deb6-ce82-46ed-929f-4e2caee2aef1 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:43:40.449919 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-0aa8deb6-ce82-46ed-929f-4e2caee2aef1 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:43:40.452025 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-0aa8deb6-ce82-46ed-929f-4e2caee2aef1 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:43:40.452978 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-d938e11c-7977-414f-a373-2669a6f058e3 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:43:40.453482 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-d938e11c-7977-414f-a373-2669a6f058e3 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:43:40.454027 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-0aa8deb6-ce82-46ed-929f-4e2caee2aef1 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:43:40.688963 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-0aa8deb6-ce82-46ed-929f-4e2caee2aef1 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:43:40.697769 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-0aa8deb6-ce82-46ed-929f-4e2caee2aef1 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:43:40.699306 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-0aa8deb6-ce82-46ed-929f-4e2caee2aef1 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:43:40.700556 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-0aa8deb6-ce82-46ed-929f-4e2caee2aef1 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] 10.222.0.42 "GET /compute/v2.1/servers/ce3b66f8-03e9-4d5f-8c40-d1a887b12304" status: 200 len: 1721 microversion: 2.20 time: 0.281945 Jun 06 10:43:40.701112 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 331/644] 10.222.0.42 () {60 vars in 1276 bytes} [Mon Jun 6 10:43:40 2022] GET /compute/v2.1/servers/ce3b66f8-03e9-4d5f-8c40-d1a887b12304 => generated 1721 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 10:43:40.711056 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-d938e11c-7977-414f-a373-2669a6f058e3 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ba341ea1ac34874bbfb8b2f713aea1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92244b4ae17d49bebe621e803bd9ae58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:43:40.711613 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-d938e11c-7977-414f-a373-2669a6f058e3 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] 10.222.0.42 "GET /compute/v2.1/servers/3827eb37-6346-4a31-a6e5-25b90628827c" status: 200 len: 1367 microversion: 2.1 time: 0.286614 Jun 06 10:43:40.712281 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 314/645] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:43:40 2022] GET /compute/v2.1/servers/3827eb37-6346-4a31-a6e5-25b90628827c => generated 1367 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 10:43:41.580267 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-19e48e25-0914-44c1-8794-c2ce4ea3b498 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:43:41.580757 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-19e48e25-0914-44c1-8794-c2ce4ea3b498 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] [instance: bd2981c6-1a22-4f44-9154-170abe988e75] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:43:41.587183 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-19e48e25-0914-44c1-8794-c2ce4ea3b498 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:43:41.587633 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-19e48e25-0914-44c1-8794-c2ce4ea3b498 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:43:41.588448 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-19e48e25-0914-44c1-8794-c2ce4ea3b498 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:43:41.588884 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-19e48e25-0914-44c1-8794-c2ce4ea3b498 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:43:41.613120 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-19e48e25-0914-44c1-8794-c2ce4ea3b498 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] 10.222.0.42 "GET /compute/v2.1/servers/bd2981c6-1a22-4f44-9154-170abe988e75/ips" status: 200 len: 145 microversion: 2.1 time: 0.168702 Jun 06 10:43:41.613700 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 332/646] 10.222.0.42 () {58 vars in 1247 bytes} [Mon Jun 6 10:43:41 2022] GET /compute/v2.1/servers/bd2981c6-1a22-4f44-9154-170abe988e75/ips => generated 145 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 10:43:41.718987 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-44ea277d-88f2-4866-a9cb-e1f4847c7012 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:43:41.720416 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-44ea277d-88f2-4866-a9cb-e1f4847c7012 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] [instance: ce3b66f8-03e9-4d5f-8c40-d1a887b12304] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:43:41.729665 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-83b30fc3-7fbc-428f-a3b7-169511ec3c98 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:43:41.730517 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-83b30fc3-7fbc-428f-a3b7-169511ec3c98 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] [instance: 3827eb37-6346-4a31-a6e5-25b90628827c] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:43:41.732802 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-44ea277d-88f2-4866-a9cb-e1f4847c7012 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:43:41.733768 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-44ea277d-88f2-4866-a9cb-e1f4847c7012 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:43:41.734820 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-44ea277d-88f2-4866-a9cb-e1f4847c7012 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:43:41.735364 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-44ea277d-88f2-4866-a9cb-e1f4847c7012 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:43:41.740807 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-83b30fc3-7fbc-428f-a3b7-169511ec3c98 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:43:41.741873 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-83b30fc3-7fbc-428f-a3b7-169511ec3c98 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:43:41.743915 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-83b30fc3-7fbc-428f-a3b7-169511ec3c98 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:43:41.744747 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-83b30fc3-7fbc-428f-a3b7-169511ec3c98 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:43:42.074571 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-44ea277d-88f2-4866-a9cb-e1f4847c7012 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:43:42.079254 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG dbcounter [-] [129350] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=129350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 10:43:42.085031 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-44ea277d-88f2-4866-a9cb-e1f4847c7012 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:43:42.086221 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-83b30fc3-7fbc-428f-a3b7-169511ec3c98 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ba341ea1ac34874bbfb8b2f713aea1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92244b4ae17d49bebe621e803bd9ae58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:43:42.086756 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-44ea277d-88f2-4866-a9cb-e1f4847c7012 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:43:42.087962 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-44ea277d-88f2-4866-a9cb-e1f4847c7012 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] 10.222.0.42 "GET /compute/v2.1/servers/ce3b66f8-03e9-4d5f-8c40-d1a887b12304" status: 200 len: 1721 microversion: 2.20 time: 0.373078 Jun 06 10:43:42.089185 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 315/647] 10.222.0.42 () {60 vars in 1276 bytes} [Mon Jun 6 10:43:41 2022] GET /compute/v2.1/servers/ce3b66f8-03e9-4d5f-8c40-d1a887b12304 => generated 1721 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 10:43:42.095301 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-83b30fc3-7fbc-428f-a3b7-169511ec3c98 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] 10.222.0.42 "GET /compute/v2.1/servers/3827eb37-6346-4a31-a6e5-25b90628827c" status: 200 len: 1367 microversion: 2.1 time: 0.370300 Jun 06 10:43:42.099164 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 333/648] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:43:41 2022] GET /compute/v2.1/servers/3827eb37-6346-4a31-a6e5-25b90628827c => generated 1367 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:43:42.974363 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-10268121-1322-42eb-a642-5a05d9d33fc6 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "39838e9e-1921-4b8d-bdde-df4254bafe3c"}} {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 10:43:42.975486 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-10268121-1322-42eb-a642-5a05d9d33fc6 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] [instance: bd2981c6-1a22-4f44-9154-170abe988e75] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:43:42.984243 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-10268121-1322-42eb-a642-5a05d9d33fc6 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:43:42.984689 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-10268121-1322-42eb-a642-5a05d9d33fc6 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:43:42.985470 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-10268121-1322-42eb-a642-5a05d9d33fc6 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:43:42.985902 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-10268121-1322-42eb-a642-5a05d9d33fc6 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:43:43.108482 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-4e7ceceb-d036-4225-8930-6710a6a08958 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:43:43.109096 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-4e7ceceb-d036-4225-8930-6710a6a08958 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] [instance: ce3b66f8-03e9-4d5f-8c40-d1a887b12304] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:43:43.111696 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG dbcounter [-] [129349] Writing DB stats nova_cell0:SELECT=2 {{(pid=129349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 10:43:43.112419 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG dbcounter [-] [129349] Writing DB stats nova_cell0:SELECT=8 {{(pid=129349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 10:43:43.117816 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-4e7ceceb-d036-4225-8930-6710a6a08958 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:43:43.118258 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-4e7ceceb-d036-4225-8930-6710a6a08958 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:43:43.119313 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-4e7ceceb-d036-4225-8930-6710a6a08958 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:43:43.119840 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-4e7ceceb-d036-4225-8930-6710a6a08958 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:43:43.260674 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-10268121-1322-42eb-a642-5a05d9d33fc6 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] 10.222.0.42 "POST /compute/v2.1/servers/bd2981c6-1a22-4f44-9154-170abe988e75/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.290991 Jun 06 10:43:43.261297 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 316/649] 10.222.0.42 () {60 vars in 1322 bytes} [Mon Jun 6 10:43:42 2022] POST /compute/v2.1/servers/bd2981c6-1a22-4f44-9154-170abe988e75/os-volume_attachments => generated 194 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 10:43:43.281012 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-4e7ceceb-d036-4225-8930-6710a6a08958 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:43:43.283936 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-8cc69621-00da-4fc8-a5cc-93959ab7c13c tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:43:43.285595 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-8cc69621-00da-4fc8-a5cc-93959ab7c13c tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] [instance: 3827eb37-6346-4a31-a6e5-25b90628827c] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:43:43.293423 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-4e7ceceb-d036-4225-8930-6710a6a08958 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:43:43.295339 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-8cc69621-00da-4fc8-a5cc-93959ab7c13c tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:43:43.295933 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-8cc69621-00da-4fc8-a5cc-93959ab7c13c tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:43:43.298263 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-4e7ceceb-d036-4225-8930-6710a6a08958 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:43:43.298803 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-8cc69621-00da-4fc8-a5cc-93959ab7c13c tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:43:43.299860 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-8cc69621-00da-4fc8-a5cc-93959ab7c13c tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:43:43.300616 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-4e7ceceb-d036-4225-8930-6710a6a08958 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] 10.222.0.42 "GET /compute/v2.1/servers/ce3b66f8-03e9-4d5f-8c40-d1a887b12304" status: 200 len: 1721 microversion: 2.20 time: 0.197848 Jun 06 10:43:43.301257 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 334/650] 10.222.0.42 () {60 vars in 1276 bytes} [Mon Jun 6 10:43:43 2022] GET /compute/v2.1/servers/ce3b66f8-03e9-4d5f-8c40-d1a887b12304 => generated 1721 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 06 10:43:43.466765 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-8cc69621-00da-4fc8-a5cc-93959ab7c13c tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ba341ea1ac34874bbfb8b2f713aea1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92244b4ae17d49bebe621e803bd9ae58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:43:43.474464 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-8cc69621-00da-4fc8-a5cc-93959ab7c13c tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] 10.222.0.42 "GET /compute/v2.1/servers/3827eb37-6346-4a31-a6e5-25b90628827c" status: 200 len: 1556 microversion: 2.1 time: 0.211475 Jun 06 10:43:43.475038 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 317/651] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:43:43 2022] GET /compute/v2.1/servers/3827eb37-6346-4a31-a6e5-25b90628827c => generated 1556 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:43:43.491214 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-eaae275f-3a33-4df9-8344-3160ebad16df tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:43:43.491715 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-eaae275f-3a33-4df9-8344-3160ebad16df tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] [instance: 3827eb37-6346-4a31-a6e5-25b90628827c] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:43:43.497915 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-eaae275f-3a33-4df9-8344-3160ebad16df tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:43:43.498438 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-eaae275f-3a33-4df9-8344-3160ebad16df tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:43:43.499237 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-eaae275f-3a33-4df9-8344-3160ebad16df tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:43:43.499746 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-eaae275f-3a33-4df9-8344-3160ebad16df tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:43:43.578581 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-eaae275f-3a33-4df9-8344-3160ebad16df tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] 10.222.0.42 "GET /compute/v2.1/servers/3827eb37-6346-4a31-a6e5-25b90628827c/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.091158 Jun 06 10:43:43.579305 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 335/652] 10.222.0.42 () {58 vars in 1274 bytes} [Mon Jun 6 10:43:43 2022] GET /compute/v2.1/servers/3827eb37-6346-4a31-a6e5-25b90628827c/os-interface => generated 284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 10:43:44.320657 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-28d5e176-ba6f-4c2b-9c04-a85d1e8e2fb5 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:43:44.321256 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-28d5e176-ba6f-4c2b-9c04-a85d1e8e2fb5 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] [instance: ce3b66f8-03e9-4d5f-8c40-d1a887b12304] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:43:44.328837 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-28d5e176-ba6f-4c2b-9c04-a85d1e8e2fb5 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:43:44.329276 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-28d5e176-ba6f-4c2b-9c04-a85d1e8e2fb5 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:43:44.330090 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-28d5e176-ba6f-4c2b-9c04-a85d1e8e2fb5 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:43:44.330737 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-28d5e176-ba6f-4c2b-9c04-a85d1e8e2fb5 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:43:44.473167 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-28d5e176-ba6f-4c2b-9c04-a85d1e8e2fb5 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:43:44.484410 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-28d5e176-ba6f-4c2b-9c04-a85d1e8e2fb5 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:43:44.485921 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-28d5e176-ba6f-4c2b-9c04-a85d1e8e2fb5 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:43:44.487087 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-28d5e176-ba6f-4c2b-9c04-a85d1e8e2fb5 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] 10.222.0.42 "GET /compute/v2.1/servers/ce3b66f8-03e9-4d5f-8c40-d1a887b12304" status: 200 len: 1721 microversion: 2.20 time: 0.170370 Jun 06 10:43:44.487639 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 318/653] 10.222.0.42 () {60 vars in 1276 bytes} [Mon Jun 6 10:43:44 2022] GET /compute/v2.1/servers/ce3b66f8-03e9-4d5f-8c40-d1a887b12304 => generated 1721 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 10:43:44.971026 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [req-0b479df0-dbb4-47a2-b007-0087d869a4d4 req-b2743578-0a1a-4a4f-a98a-062d04141b2a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3827eb37-6346-4a31-a6e5-25b90628827c", "tag": "db231a6f-2db0-4cdc-851e-c9e6ca043bb0"}]} {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 10:43:44.979272 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [req-0b479df0-dbb4-47a2-b007-0087d869a4d4 req-b2743578-0a1a-4a4f-a98a-062d04141b2a service nova] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:43:44.979712 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [req-0b479df0-dbb4-47a2-b007-0087d869a4d4 req-b2743578-0a1a-4a4f-a98a-062d04141b2a service nova] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:43:44.992398 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.compute.server_external_events [req-0b479df0-dbb4-47a2-b007-0087d869a4d4 req-b2743578-0a1a-4a4f-a98a-062d04141b2a service nova] Creating event network-changed:db231a6f-2db0-4cdc-851e-c9e6ca043bb0 for instance 3827eb37-6346-4a31-a6e5-25b90628827c on hv-cinder-84482 Jun 06 10:43:44.999565 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [req-0b479df0-dbb4-47a2-b007-0087d869a4d4 req-b2743578-0a1a-4a4f-a98a-062d04141b2a service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.216635 Jun 06 10:43:45.000205 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 336/654] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Jun 6 10:43:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 10:43:45.505425 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-46562b79-5d16-47ec-b641-9eee718ce907 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:43:45.506042 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-46562b79-5d16-47ec-b641-9eee718ce907 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] [instance: ce3b66f8-03e9-4d5f-8c40-d1a887b12304] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:43:45.512930 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-46562b79-5d16-47ec-b641-9eee718ce907 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:43:45.513388 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-46562b79-5d16-47ec-b641-9eee718ce907 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:43:45.514164 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-46562b79-5d16-47ec-b641-9eee718ce907 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:43:45.514596 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-46562b79-5d16-47ec-b641-9eee718ce907 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:43:45.655250 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-46562b79-5d16-47ec-b641-9eee718ce907 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:43:45.663576 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-46562b79-5d16-47ec-b641-9eee718ce907 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:43:45.665119 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-46562b79-5d16-47ec-b641-9eee718ce907 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:43:45.666273 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-46562b79-5d16-47ec-b641-9eee718ce907 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] 10.222.0.42 "GET /compute/v2.1/servers/ce3b66f8-03e9-4d5f-8c40-d1a887b12304" status: 200 len: 1721 microversion: 2.20 time: 0.164720 Jun 06 10:43:45.666834 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 319/655] 10.222.0.42 () {60 vars in 1276 bytes} [Mon Jun 6 10:43:45 2022] GET /compute/v2.1/servers/ce3b66f8-03e9-4d5f-8c40-d1a887b12304 => generated 1721 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 10:43:46.686391 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-8ada390a-9789-4650-ac9c-2b1b98494280 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:43:46.687115 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-8ada390a-9789-4650-ac9c-2b1b98494280 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] [instance: ce3b66f8-03e9-4d5f-8c40-d1a887b12304] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:43:46.693416 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-8ada390a-9789-4650-ac9c-2b1b98494280 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:43:46.693858 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-8ada390a-9789-4650-ac9c-2b1b98494280 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:43:46.694615 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-8ada390a-9789-4650-ac9c-2b1b98494280 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:43:46.695047 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-8ada390a-9789-4650-ac9c-2b1b98494280 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:43:46.826234 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-8ada390a-9789-4650-ac9c-2b1b98494280 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:43:46.834114 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-8ada390a-9789-4650-ac9c-2b1b98494280 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:43:46.835639 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-8ada390a-9789-4650-ac9c-2b1b98494280 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:43:46.836895 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-8ada390a-9789-4650-ac9c-2b1b98494280 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] 10.222.0.42 "GET /compute/v2.1/servers/ce3b66f8-03e9-4d5f-8c40-d1a887b12304" status: 200 len: 1721 microversion: 2.20 time: 0.155341 Jun 06 10:43:46.837453 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 337/656] 10.222.0.42 () {60 vars in 1276 bytes} [Mon Jun 6 10:43:46 2022] GET /compute/v2.1/servers/ce3b66f8-03e9-4d5f-8c40-d1a887b12304 => generated 1721 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 10:43:47.855925 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-f29b9480-b229-459b-b62f-7475d04f59fe tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:43:47.857167 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-f29b9480-b229-459b-b62f-7475d04f59fe tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] [instance: ce3b66f8-03e9-4d5f-8c40-d1a887b12304] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:43:47.863711 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-f29b9480-b229-459b-b62f-7475d04f59fe tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:43:47.864187 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-f29b9480-b229-459b-b62f-7475d04f59fe tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:43:47.864949 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-f29b9480-b229-459b-b62f-7475d04f59fe tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:43:47.865382 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-f29b9480-b229-459b-b62f-7475d04f59fe tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:43:47.993722 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-f29b9480-b229-459b-b62f-7475d04f59fe tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:43:48.001998 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-f29b9480-b229-459b-b62f-7475d04f59fe tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:43:48.003490 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-f29b9480-b229-459b-b62f-7475d04f59fe tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:43:48.004720 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-f29b9480-b229-459b-b62f-7475d04f59fe tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] 10.222.0.42 "GET /compute/v2.1/servers/ce3b66f8-03e9-4d5f-8c40-d1a887b12304" status: 200 len: 1721 microversion: 2.20 time: 0.152774 Jun 06 10:43:48.005221 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 320/657] 10.222.0.42 () {60 vars in 1276 bytes} [Mon Jun 6 10:43:47 2022] GET /compute/v2.1/servers/ce3b66f8-03e9-4d5f-8c40-d1a887b12304 => generated 1721 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 10:43:49.023199 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-f493308f-efd1-4b3a-9b49-8379afcab56b tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:43:49.023826 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-f493308f-efd1-4b3a-9b49-8379afcab56b tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] [instance: ce3b66f8-03e9-4d5f-8c40-d1a887b12304] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:43:49.030327 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-f493308f-efd1-4b3a-9b49-8379afcab56b tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:43:49.030773 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-f493308f-efd1-4b3a-9b49-8379afcab56b tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:43:49.031527 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-f493308f-efd1-4b3a-9b49-8379afcab56b tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:43:49.031984 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-f493308f-efd1-4b3a-9b49-8379afcab56b tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:43:49.169978 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-f493308f-efd1-4b3a-9b49-8379afcab56b tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:43:49.178509 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-f493308f-efd1-4b3a-9b49-8379afcab56b tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:43:49.180403 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-f493308f-efd1-4b3a-9b49-8379afcab56b tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:43:49.181672 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-f493308f-efd1-4b3a-9b49-8379afcab56b tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] 10.222.0.42 "GET /compute/v2.1/servers/ce3b66f8-03e9-4d5f-8c40-d1a887b12304" status: 200 len: 1721 microversion: 2.20 time: 0.162330 Jun 06 10:43:49.182315 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 338/658] 10.222.0.42 () {60 vars in 1276 bytes} [Mon Jun 6 10:43:49 2022] GET /compute/v2.1/servers/ce3b66f8-03e9-4d5f-8c40-d1a887b12304 => generated 1721 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 10:43:49.689525 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-65c0ee1a-7c6d-49af-9f74-7e191d830b5b tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:43:49.690520 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-65c0ee1a-7c6d-49af-9f74-7e191d830b5b tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] [instance: bd2981c6-1a22-4f44-9154-170abe988e75] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:43:49.697050 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-65c0ee1a-7c6d-49af-9f74-7e191d830b5b tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:43:49.697494 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-65c0ee1a-7c6d-49af-9f74-7e191d830b5b tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:43:49.698255 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-65c0ee1a-7c6d-49af-9f74-7e191d830b5b tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:43:49.698688 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-65c0ee1a-7c6d-49af-9f74-7e191d830b5b tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:43:49.728991 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-65c0ee1a-7c6d-49af-9f74-7e191d830b5b tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] 10.222.0.42 "GET /compute/v2.1/servers/bd2981c6-1a22-4f44-9154-170abe988e75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043363 Jun 06 10:43:49.729544 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 321/659] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jun 6 10:43:49 2022] GET /compute/v2.1/servers/bd2981c6-1a22-4f44-9154-170abe988e75/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 10:43:49.739326 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-db5ea174-36c7-41dd-8b27-c822aea58c73 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:43:49.739852 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-db5ea174-36c7-41dd-8b27-c822aea58c73 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] [instance: bd2981c6-1a22-4f44-9154-170abe988e75] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:43:49.745808 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-db5ea174-36c7-41dd-8b27-c822aea58c73 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:43:49.746268 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-db5ea174-36c7-41dd-8b27-c822aea58c73 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:43:49.747046 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-db5ea174-36c7-41dd-8b27-c822aea58c73 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:43:49.747474 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-db5ea174-36c7-41dd-8b27-c822aea58c73 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:43:49.777179 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-db5ea174-36c7-41dd-8b27-c822aea58c73 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] 10.222.0.42 "GET /compute/v2.1/servers/bd2981c6-1a22-4f44-9154-170abe988e75/os-volume_attachments/39838e9e-1921-4b8d-bdde-df4254bafe3c" status: 200 len: 194 microversion: 2.1 time: 0.041715 Jun 06 10:43:49.778360 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 339/660] 10.222.0.42 () {58 vars in 1412 bytes} [Mon Jun 6 10:43:49 2022] GET /compute/v2.1/servers/bd2981c6-1a22-4f44-9154-170abe988e75/os-volume_attachments/39838e9e-1921-4b8d-bdde-df4254bafe3c => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 10:43:50.200657 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-09deadf3-95ed-4056-9591-1caa83bfa179 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:43:50.201413 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-09deadf3-95ed-4056-9591-1caa83bfa179 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] [instance: ce3b66f8-03e9-4d5f-8c40-d1a887b12304] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:43:50.207662 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-09deadf3-95ed-4056-9591-1caa83bfa179 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:43:50.208158 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-09deadf3-95ed-4056-9591-1caa83bfa179 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:43:50.208963 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-09deadf3-95ed-4056-9591-1caa83bfa179 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:43:50.209426 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-09deadf3-95ed-4056-9591-1caa83bfa179 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:43:50.341044 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-09deadf3-95ed-4056-9591-1caa83bfa179 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:43:50.349012 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-09deadf3-95ed-4056-9591-1caa83bfa179 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:43:50.350509 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-09deadf3-95ed-4056-9591-1caa83bfa179 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:43:50.351638 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-09deadf3-95ed-4056-9591-1caa83bfa179 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] 10.222.0.42 "GET /compute/v2.1/servers/ce3b66f8-03e9-4d5f-8c40-d1a887b12304" status: 200 len: 1721 microversion: 2.20 time: 0.155776 Jun 06 10:43:50.352233 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 322/661] 10.222.0.42 () {60 vars in 1276 bytes} [Mon Jun 6 10:43:50 2022] GET /compute/v2.1/servers/ce3b66f8-03e9-4d5f-8c40-d1a887b12304 => generated 1721 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 10:43:51.095129 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-707fc51e-05aa-4c69-aaa2-19370050a360 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e1808344-d12a-4c69-8eff-57d53f8be744"}} {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 10:43:51.096311 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-707fc51e-05aa-4c69-aaa2-19370050a360 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] [instance: bd2981c6-1a22-4f44-9154-170abe988e75] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:43:51.102841 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-707fc51e-05aa-4c69-aaa2-19370050a360 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:43:51.103281 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-707fc51e-05aa-4c69-aaa2-19370050a360 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:43:51.104090 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-707fc51e-05aa-4c69-aaa2-19370050a360 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:43:51.104522 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-707fc51e-05aa-4c69-aaa2-19370050a360 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:43:51.347719 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-707fc51e-05aa-4c69-aaa2-19370050a360 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] 10.222.0.42 "POST /compute/v2.1/servers/bd2981c6-1a22-4f44-9154-170abe988e75/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.257257 Jun 06 10:43:51.348374 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 340/662] 10.222.0.42 () {60 vars in 1322 bytes} [Mon Jun 6 10:43:51 2022] POST /compute/v2.1/servers/bd2981c6-1a22-4f44-9154-170abe988e75/os-volume_attachments => generated 194 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 10:43:51.370873 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-d09f106b-bf7e-4fa1-8e20-523b2e4b07d2 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:43:51.371820 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-d09f106b-bf7e-4fa1-8e20-523b2e4b07d2 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] [instance: ce3b66f8-03e9-4d5f-8c40-d1a887b12304] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:43:51.379614 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-d09f106b-bf7e-4fa1-8e20-523b2e4b07d2 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:43:51.380166 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-d09f106b-bf7e-4fa1-8e20-523b2e4b07d2 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:43:51.381004 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-d09f106b-bf7e-4fa1-8e20-523b2e4b07d2 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:43:51.381645 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-d09f106b-bf7e-4fa1-8e20-523b2e4b07d2 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:43:51.520726 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-d09f106b-bf7e-4fa1-8e20-523b2e4b07d2 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:43:51.529538 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-d09f106b-bf7e-4fa1-8e20-523b2e4b07d2 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:43:51.531106 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-d09f106b-bf7e-4fa1-8e20-523b2e4b07d2 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:43:51.532345 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-d09f106b-bf7e-4fa1-8e20-523b2e4b07d2 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] 10.222.0.42 "GET /compute/v2.1/servers/ce3b66f8-03e9-4d5f-8c40-d1a887b12304" status: 200 len: 1721 microversion: 2.20 time: 0.165952 Jun 06 10:43:51.532909 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 323/663] 10.222.0.42 () {60 vars in 1276 bytes} [Mon Jun 6 10:43:51 2022] GET /compute/v2.1/servers/ce3b66f8-03e9-4d5f-8c40-d1a887b12304 => generated 1721 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 10:43:52.551266 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-b6421c2d-26d9-4ac9-9487-4712b2a113f6 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:43:52.551984 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-b6421c2d-26d9-4ac9-9487-4712b2a113f6 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] [instance: ce3b66f8-03e9-4d5f-8c40-d1a887b12304] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:43:52.558138 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-b6421c2d-26d9-4ac9-9487-4712b2a113f6 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:43:52.558575 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-b6421c2d-26d9-4ac9-9487-4712b2a113f6 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:43:52.559748 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-b6421c2d-26d9-4ac9-9487-4712b2a113f6 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:43:52.560209 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-b6421c2d-26d9-4ac9-9487-4712b2a113f6 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:43:52.694247 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-b6421c2d-26d9-4ac9-9487-4712b2a113f6 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:43:52.702548 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-b6421c2d-26d9-4ac9-9487-4712b2a113f6 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:43:52.704088 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-b6421c2d-26d9-4ac9-9487-4712b2a113f6 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:43:52.705241 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-b6421c2d-26d9-4ac9-9487-4712b2a113f6 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] 10.222.0.42 "GET /compute/v2.1/servers/ce3b66f8-03e9-4d5f-8c40-d1a887b12304" status: 200 len: 1721 microversion: 2.20 time: 0.158715 Jun 06 10:43:52.705794 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 341/664] 10.222.0.42 () {60 vars in 1276 bytes} [Mon Jun 6 10:43:52 2022] GET /compute/v2.1/servers/ce3b66f8-03e9-4d5f-8c40-d1a887b12304 => generated 1721 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 10:43:53.724339 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-254b42ee-6da9-4c3a-b26f-394dafdd39eb tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:43:53.724948 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-254b42ee-6da9-4c3a-b26f-394dafdd39eb tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] [instance: ce3b66f8-03e9-4d5f-8c40-d1a887b12304] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:43:53.732235 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-254b42ee-6da9-4c3a-b26f-394dafdd39eb tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:43:53.732706 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-254b42ee-6da9-4c3a-b26f-394dafdd39eb tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:43:53.733453 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-254b42ee-6da9-4c3a-b26f-394dafdd39eb tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:43:53.733880 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-254b42ee-6da9-4c3a-b26f-394dafdd39eb tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:43:53.865315 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-254b42ee-6da9-4c3a-b26f-394dafdd39eb tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:43:53.873751 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-254b42ee-6da9-4c3a-b26f-394dafdd39eb tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:43:53.875256 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-254b42ee-6da9-4c3a-b26f-394dafdd39eb tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:43:53.876478 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-254b42ee-6da9-4c3a-b26f-394dafdd39eb tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] 10.222.0.42 "GET /compute/v2.1/servers/ce3b66f8-03e9-4d5f-8c40-d1a887b12304" status: 200 len: 1721 microversion: 2.20 time: 0.156114 Jun 06 10:43:53.877024 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 324/665] 10.222.0.42 () {60 vars in 1276 bytes} [Mon Jun 6 10:43:53 2022] GET /compute/v2.1/servers/ce3b66f8-03e9-4d5f-8c40-d1a887b12304 => generated 1721 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 10:43:54.895599 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-e6844920-fbbf-41f6-87f6-f2328c4ff903 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:43:54.896239 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-e6844920-fbbf-41f6-87f6-f2328c4ff903 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] [instance: ce3b66f8-03e9-4d5f-8c40-d1a887b12304] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:43:54.903392 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-e6844920-fbbf-41f6-87f6-f2328c4ff903 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:43:54.903858 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-e6844920-fbbf-41f6-87f6-f2328c4ff903 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:43:54.904628 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-e6844920-fbbf-41f6-87f6-f2328c4ff903 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:43:54.905066 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-e6844920-fbbf-41f6-87f6-f2328c4ff903 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:43:55.032125 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-e6844920-fbbf-41f6-87f6-f2328c4ff903 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:43:55.039945 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-e6844920-fbbf-41f6-87f6-f2328c4ff903 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:43:55.041453 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-e6844920-fbbf-41f6-87f6-f2328c4ff903 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:43:55.042596 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-e6844920-fbbf-41f6-87f6-f2328c4ff903 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] 10.222.0.42 "GET /compute/v2.1/servers/ce3b66f8-03e9-4d5f-8c40-d1a887b12304" status: 200 len: 1721 microversion: 2.20 time: 0.150904 Jun 06 10:43:55.043722 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 342/666] 10.222.0.42 () {60 vars in 1276 bytes} [Mon Jun 6 10:43:54 2022] GET /compute/v2.1/servers/ce3b66f8-03e9-4d5f-8c40-d1a887b12304 => generated 1721 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 10:43:56.062410 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-deaa8770-53c4-4079-ac48-e64a77c389ee tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:43:56.062944 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-deaa8770-53c4-4079-ac48-e64a77c389ee tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] [instance: ce3b66f8-03e9-4d5f-8c40-d1a887b12304] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:43:56.069478 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-deaa8770-53c4-4079-ac48-e64a77c389ee tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:43:56.069921 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-deaa8770-53c4-4079-ac48-e64a77c389ee tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:43:56.070677 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-deaa8770-53c4-4079-ac48-e64a77c389ee tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:43:56.071108 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-deaa8770-53c4-4079-ac48-e64a77c389ee tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:43:56.204405 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-deaa8770-53c4-4079-ac48-e64a77c389ee tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:43:56.212215 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-deaa8770-53c4-4079-ac48-e64a77c389ee tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:43:56.213719 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-deaa8770-53c4-4079-ac48-e64a77c389ee tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:43:56.214922 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-deaa8770-53c4-4079-ac48-e64a77c389ee tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] 10.222.0.42 "GET /compute/v2.1/servers/ce3b66f8-03e9-4d5f-8c40-d1a887b12304" status: 200 len: 1721 microversion: 2.20 time: 0.157034 Jun 06 10:43:56.215546 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 325/667] 10.222.0.42 () {60 vars in 1276 bytes} [Mon Jun 6 10:43:56 2022] GET /compute/v2.1/servers/ce3b66f8-03e9-4d5f-8c40-d1a887b12304 => generated 1721 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 10:43:57.233754 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-e02716ea-62a5-4c1f-8fae-3443fef274af tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:43:57.234403 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-e02716ea-62a5-4c1f-8fae-3443fef274af tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] [instance: ce3b66f8-03e9-4d5f-8c40-d1a887b12304] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:43:57.240871 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-e02716ea-62a5-4c1f-8fae-3443fef274af tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:43:57.241321 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-e02716ea-62a5-4c1f-8fae-3443fef274af tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:43:57.242092 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-e02716ea-62a5-4c1f-8fae-3443fef274af tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:43:57.242530 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-e02716ea-62a5-4c1f-8fae-3443fef274af tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:43:57.373100 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-e02716ea-62a5-4c1f-8fae-3443fef274af tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:43:57.381337 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-e02716ea-62a5-4c1f-8fae-3443fef274af tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:43:57.382862 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-e02716ea-62a5-4c1f-8fae-3443fef274af tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:43:57.384058 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-e02716ea-62a5-4c1f-8fae-3443fef274af tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] 10.222.0.42 "GET /compute/v2.1/servers/ce3b66f8-03e9-4d5f-8c40-d1a887b12304" status: 200 len: 1721 microversion: 2.20 time: 0.154927 Jun 06 10:43:57.384613 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 343/668] 10.222.0.42 () {60 vars in 1276 bytes} [Mon Jun 6 10:43:57 2022] GET /compute/v2.1/servers/ce3b66f8-03e9-4d5f-8c40-d1a887b12304 => generated 1721 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 10:43:58.403664 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-b4c54fda-2a0a-4770-a550-abc57db120ed tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:43:58.404366 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-b4c54fda-2a0a-4770-a550-abc57db120ed tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] [instance: ce3b66f8-03e9-4d5f-8c40-d1a887b12304] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:43:58.411460 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-b4c54fda-2a0a-4770-a550-abc57db120ed tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:43:58.411954 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-b4c54fda-2a0a-4770-a550-abc57db120ed tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:43:58.412804 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-b4c54fda-2a0a-4770-a550-abc57db120ed tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:43:58.413338 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-b4c54fda-2a0a-4770-a550-abc57db120ed tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:43:58.540159 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-b4c54fda-2a0a-4770-a550-abc57db120ed tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:43:58.549637 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-b4c54fda-2a0a-4770-a550-abc57db120ed tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:43:58.551213 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-b4c54fda-2a0a-4770-a550-abc57db120ed tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:43:58.552401 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-b4c54fda-2a0a-4770-a550-abc57db120ed tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] 10.222.0.42 "GET /compute/v2.1/servers/ce3b66f8-03e9-4d5f-8c40-d1a887b12304" status: 200 len: 1742 microversion: 2.20 time: 0.153526 Jun 06 10:43:58.552958 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 326/669] 10.222.0.42 () {60 vars in 1276 bytes} [Mon Jun 6 10:43:58 2022] GET /compute/v2.1/servers/ce3b66f8-03e9-4d5f-8c40-d1a887b12304 => generated 1742 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 10:43:58.801622 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-4d284448-0bfa-4c53-821d-e9fca76afb2c tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:43:58.802556 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-4d284448-0bfa-4c53-821d-e9fca76afb2c tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] [instance: bd2981c6-1a22-4f44-9154-170abe988e75] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:43:58.809667 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-4d284448-0bfa-4c53-821d-e9fca76afb2c tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:43:58.810111 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-4d284448-0bfa-4c53-821d-e9fca76afb2c tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:43:58.810875 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-4d284448-0bfa-4c53-821d-e9fca76afb2c tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:43:58.811315 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-4d284448-0bfa-4c53-821d-e9fca76afb2c tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:43:58.836063 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG dbcounter [-] [129349] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 10:43:58.841845 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-4d284448-0bfa-4c53-821d-e9fca76afb2c tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] 10.222.0.42 "GET /compute/v2.1/servers/bd2981c6-1a22-4f44-9154-170abe988e75/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044155 Jun 06 10:43:58.842394 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 344/670] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jun 6 10:43:58 2022] GET /compute/v2.1/servers/bd2981c6-1a22-4f44-9154-170abe988e75/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 10:43:58.980017 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-794f51f3-37c3-4214-90ad-6558786c7c9d tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:43:58.981016 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-794f51f3-37c3-4214-90ad-6558786c7c9d tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] [instance: bd2981c6-1a22-4f44-9154-170abe988e75] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:43:58.987124 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-794f51f3-37c3-4214-90ad-6558786c7c9d tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:43:58.987562 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-794f51f3-37c3-4214-90ad-6558786c7c9d tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:43:58.988339 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-794f51f3-37c3-4214-90ad-6558786c7c9d tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:43:58.988762 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-794f51f3-37c3-4214-90ad-6558786c7c9d tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:43:59.017198 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-794f51f3-37c3-4214-90ad-6558786c7c9d tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] 10.222.0.42 "GET /compute/v2.1/servers/bd2981c6-1a22-4f44-9154-170abe988e75/os-volume_attachments/39838e9e-1921-4b8d-bdde-df4254bafe3c" status: 200 len: 194 microversion: 2.1 time: 0.041221 Jun 06 10:43:59.017772 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 327/671] 10.222.0.42 () {58 vars in 1412 bytes} [Mon Jun 6 10:43:58 2022] GET /compute/v2.1/servers/bd2981c6-1a22-4f44-9154-170abe988e75/os-volume_attachments/39838e9e-1921-4b8d-bdde-df4254bafe3c => generated 194 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 10:43:59.027318 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-ec458b1d-470c-4969-b6c5-0bd072825a9f tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:43:59.027834 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-ec458b1d-470c-4969-b6c5-0bd072825a9f tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] [instance: bd2981c6-1a22-4f44-9154-170abe988e75] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:43:59.034802 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-ec458b1d-470c-4969-b6c5-0bd072825a9f tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:43:59.035275 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-ec458b1d-470c-4969-b6c5-0bd072825a9f tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:43:59.036069 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-ec458b1d-470c-4969-b6c5-0bd072825a9f tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:43:59.036501 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-ec458b1d-470c-4969-b6c5-0bd072825a9f tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:43:59.112584 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.objects.instance [None req-ec458b1d-470c-4969-b6c5-0bd072825a9f tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lazy-loading 'services' on Instance uuid bd2981c6-1a22-4f44-9154-170abe988e75 {{(pid=129349) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 06 10:43:59.185437 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-ec458b1d-470c-4969-b6c5-0bd072825a9f tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] 10.222.0.42 "DELETE /compute/v2.1/servers/bd2981c6-1a22-4f44-9154-170abe988e75/os-volume_attachments/39838e9e-1921-4b8d-bdde-df4254bafe3c" status: 202 len: 0 microversion: 2.1 time: 0.161131 Jun 06 10:43:59.186029 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 345/672] 10.222.0.42 () {58 vars in 1415 bytes} [Mon Jun 6 10:43:59 2022] DELETE /compute/v2.1/servers/bd2981c6-1a22-4f44-9154-170abe988e75/os-volume_attachments/39838e9e-1921-4b8d-bdde-df4254bafe3c => generated 0 bytes in 163 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 06 10:43:59.571347 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-5a86b224-d648-457c-b62b-8ce888f645ea tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:43:59.571890 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-5a86b224-d648-457c-b62b-8ce888f645ea tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] [instance: ce3b66f8-03e9-4d5f-8c40-d1a887b12304] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:43:59.578534 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-5a86b224-d648-457c-b62b-8ce888f645ea tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:43:59.578976 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-5a86b224-d648-457c-b62b-8ce888f645ea tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:43:59.579734 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-5a86b224-d648-457c-b62b-8ce888f645ea tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:43:59.580209 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-5a86b224-d648-457c-b62b-8ce888f645ea tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:43:59.717834 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-5a86b224-d648-457c-b62b-8ce888f645ea tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:43:59.725820 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-5a86b224-d648-457c-b62b-8ce888f645ea tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:43:59.727348 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-5a86b224-d648-457c-b62b-8ce888f645ea tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:43:59.728524 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-5a86b224-d648-457c-b62b-8ce888f645ea tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] 10.222.0.42 "GET /compute/v2.1/servers/ce3b66f8-03e9-4d5f-8c40-d1a887b12304" status: 200 len: 1742 microversion: 2.20 time: 0.161144 Jun 06 10:43:59.729083 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 328/673] 10.222.0.42 () {60 vars in 1276 bytes} [Mon Jun 6 10:43:59 2022] GET /compute/v2.1/servers/ce3b66f8-03e9-4d5f-8c40-d1a887b12304 => generated 1742 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 10:44:00.748393 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-e7c61b59-571c-45de-a8a6-9f1e69076e3a tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:44:00.749181 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-e7c61b59-571c-45de-a8a6-9f1e69076e3a tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] [instance: ce3b66f8-03e9-4d5f-8c40-d1a887b12304] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:44:00.755891 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-e7c61b59-571c-45de-a8a6-9f1e69076e3a tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:44:00.756518 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-e7c61b59-571c-45de-a8a6-9f1e69076e3a tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:44:00.757483 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-e7c61b59-571c-45de-a8a6-9f1e69076e3a tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:44:00.758084 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-e7c61b59-571c-45de-a8a6-9f1e69076e3a tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:44:00.915050 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-e7c61b59-571c-45de-a8a6-9f1e69076e3a tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:44:00.924438 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-e7c61b59-571c-45de-a8a6-9f1e69076e3a tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:44:00.926137 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-e7c61b59-571c-45de-a8a6-9f1e69076e3a tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:44:00.927310 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-e7c61b59-571c-45de-a8a6-9f1e69076e3a tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] 10.222.0.42 "GET /compute/v2.1/servers/ce3b66f8-03e9-4d5f-8c40-d1a887b12304" status: 200 len: 1737 microversion: 2.20 time: 0.184465 Jun 06 10:44:00.938743 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 346/674] 10.222.0.42 () {60 vars in 1276 bytes} [Mon Jun 6 10:44:00 2022] GET /compute/v2.1/servers/ce3b66f8-03e9-4d5f-8c40-d1a887b12304 => generated 1737 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 10:44:01.368806 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-8f0cdcf4-b83f-4673-be90-68aaf5b01f24 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:44:01.369924 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-8f0cdcf4-b83f-4673-be90-68aaf5b01f24 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] [instance: bd2981c6-1a22-4f44-9154-170abe988e75] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:44:01.376605 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-8f0cdcf4-b83f-4673-be90-68aaf5b01f24 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:44:01.377064 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-8f0cdcf4-b83f-4673-be90-68aaf5b01f24 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:44:01.377820 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-8f0cdcf4-b83f-4673-be90-68aaf5b01f24 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:44:01.378248 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-8f0cdcf4-b83f-4673-be90-68aaf5b01f24 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:44:01.411209 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-8f0cdcf4-b83f-4673-be90-68aaf5b01f24 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] 10.222.0.42 "GET /compute/v2.1/servers/bd2981c6-1a22-4f44-9154-170abe988e75/os-volume_attachments/e1808344-d12a-4c69-8eff-57d53f8be744" status: 200 len: 194 microversion: 2.1 time: 0.046178 Jun 06 10:44:01.412470 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 329/675] 10.222.0.42 () {58 vars in 1412 bytes} [Mon Jun 6 10:44:01 2022] GET /compute/v2.1/servers/bd2981c6-1a22-4f44-9154-170abe988e75/os-volume_attachments/e1808344-d12a-4c69-8eff-57d53f8be744 => generated 194 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 10:44:01.422383 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-b3102e17-5cd4-47e7-8114-f641ced38dc3 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:44:01.423406 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-b3102e17-5cd4-47e7-8114-f641ced38dc3 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] [instance: bd2981c6-1a22-4f44-9154-170abe988e75] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:44:01.429886 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-b3102e17-5cd4-47e7-8114-f641ced38dc3 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:44:01.430333 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-b3102e17-5cd4-47e7-8114-f641ced38dc3 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:44:01.431086 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-b3102e17-5cd4-47e7-8114-f641ced38dc3 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:44:01.431529 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-b3102e17-5cd4-47e7-8114-f641ced38dc3 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:44:01.522616 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.objects.instance [None req-b3102e17-5cd4-47e7-8114-f641ced38dc3 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lazy-loading 'services' on Instance uuid bd2981c6-1a22-4f44-9154-170abe988e75 {{(pid=129349) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 06 10:44:01.601125 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-b3102e17-5cd4-47e7-8114-f641ced38dc3 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] 10.222.0.42 "DELETE /compute/v2.1/servers/bd2981c6-1a22-4f44-9154-170abe988e75/os-volume_attachments/e1808344-d12a-4c69-8eff-57d53f8be744" status: 202 len: 0 microversion: 2.1 time: 0.182883 Jun 06 10:44:01.602025 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 347/676] 10.222.0.42 () {58 vars in 1415 bytes} [Mon Jun 6 10:44:01 2022] DELETE /compute/v2.1/servers/bd2981c6-1a22-4f44-9154-170abe988e75/os-volume_attachments/e1808344-d12a-4c69-8eff-57d53f8be744 => generated 0 bytes in 184 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 06 10:44:01.946184 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-59eb45e7-1228-4f82-884d-debc7ebd180a tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:44:01.946801 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-59eb45e7-1228-4f82-884d-debc7ebd180a tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] [instance: ce3b66f8-03e9-4d5f-8c40-d1a887b12304] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:44:01.953296 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-59eb45e7-1228-4f82-884d-debc7ebd180a tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:44:01.953745 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-59eb45e7-1228-4f82-884d-debc7ebd180a tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:44:01.954767 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-59eb45e7-1228-4f82-884d-debc7ebd180a tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:44:01.955209 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-59eb45e7-1228-4f82-884d-debc7ebd180a tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:44:02.111603 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-59eb45e7-1228-4f82-884d-debc7ebd180a tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:44:02.120707 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-59eb45e7-1228-4f82-884d-debc7ebd180a tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:44:02.123211 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-59eb45e7-1228-4f82-884d-debc7ebd180a tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:44:02.124679 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-59eb45e7-1228-4f82-884d-debc7ebd180a tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] 10.222.0.42 "GET /compute/v2.1/servers/ce3b66f8-03e9-4d5f-8c40-d1a887b12304" status: 200 len: 1737 microversion: 2.20 time: 0.182449 Jun 06 10:44:02.125439 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 330/677] 10.222.0.42 () {60 vars in 1276 bytes} [Mon Jun 6 10:44:01 2022] GET /compute/v2.1/servers/ce3b66f8-03e9-4d5f-8c40-d1a887b12304 => generated 1737 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 10:44:02.409902 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [req-c380e621-d548-44b8-9d62-0b6c9c893b10 req-3d468e8e-f0b6-4dc9-becf-8999e21393a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce3b66f8-03e9-4d5f-8c40-d1a887b12304", "name": "network-vif-plugged", "status": "completed", "tag": "ff3196f2-cd2c-4cef-8ac8-2d796e5a93a2"}]} {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 10:44:02.426020 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [req-c380e621-d548-44b8-9d62-0b6c9c893b10 req-3d468e8e-f0b6-4dc9-becf-8999e21393a8 service nova] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:44:02.427129 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [req-c380e621-d548-44b8-9d62-0b6c9c893b10 req-3d468e8e-f0b6-4dc9-becf-8999e21393a8 service nova] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:44:02.445412 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.compute.server_external_events [req-c380e621-d548-44b8-9d62-0b6c9c893b10 req-3d468e8e-f0b6-4dc9-becf-8999e21393a8 service nova] Creating event network-vif-plugged:ff3196f2-cd2c-4cef-8ac8-2d796e5a93a2 for instance ce3b66f8-03e9-4d5f-8c40-d1a887b12304 on hv-cinder-84482 Jun 06 10:44:02.455063 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [req-c380e621-d548-44b8-9d62-0b6c9c893b10 req-3d468e8e-f0b6-4dc9-becf-8999e21393a8 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049657 Jun 06 10:44:02.456419 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 348/678] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Jun 6 10:44:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 06 10:44:02.797416 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-8346265e-2d06-4cfa-801c-d5872e9ff5b1 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:44:02.798386 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-8346265e-2d06-4cfa-801c-d5872e9ff5b1 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] [instance: bd2981c6-1a22-4f44-9154-170abe988e75] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:44:02.806310 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-8346265e-2d06-4cfa-801c-d5872e9ff5b1 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:44:02.806310 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-8346265e-2d06-4cfa-801c-d5872e9ff5b1 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:44:02.806310 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-8346265e-2d06-4cfa-801c-d5872e9ff5b1 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:44:02.806640 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-8346265e-2d06-4cfa-801c-d5872e9ff5b1 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:44:02.809473 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG dbcounter [-] [129350] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 10:44:02.843198 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-8346265e-2d06-4cfa-801c-d5872e9ff5b1 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] 10.222.0.42 "GET /compute/v2.1/servers/bd2981c6-1a22-4f44-9154-170abe988e75/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050246 Jun 06 10:44:02.843798 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 331/679] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jun 6 10:44:02 2022] GET /compute/v2.1/servers/bd2981c6-1a22-4f44-9154-170abe988e75/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 06 10:44:02.969343 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-19b2b088-1ebb-49bd-91e8-b2e98a8d6a54 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:44:02.970773 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-19b2b088-1ebb-49bd-91e8-b2e98a8d6a54 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] [instance: bd2981c6-1a22-4f44-9154-170abe988e75] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:44:02.977163 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-19b2b088-1ebb-49bd-91e8-b2e98a8d6a54 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:44:02.977608 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-19b2b088-1ebb-49bd-91e8-b2e98a8d6a54 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:44:02.978372 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-19b2b088-1ebb-49bd-91e8-b2e98a8d6a54 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:44:02.978806 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-19b2b088-1ebb-49bd-91e8-b2e98a8d6a54 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:44:03.016424 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-19b2b088-1ebb-49bd-91e8-b2e98a8d6a54 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] 10.222.0.42 "GET /compute/v2.1/servers/bd2981c6-1a22-4f44-9154-170abe988e75/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.052281 Jun 06 10:44:03.017200 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 349/680] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jun 6 10:44:02 2022] GET /compute/v2.1/servers/bd2981c6-1a22-4f44-9154-170abe988e75/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 06 10:44:03.084015 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-22d449fc-5e41-49ee-ba06-79954677d3fb tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:44:03.088882 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-22d449fc-5e41-49ee-ba06-79954677d3fb tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] [instance: bd2981c6-1a22-4f44-9154-170abe988e75] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:44:03.105918 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-22d449fc-5e41-49ee-ba06-79954677d3fb tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:44:03.106477 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-22d449fc-5e41-49ee-ba06-79954677d3fb tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:44:03.107355 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-22d449fc-5e41-49ee-ba06-79954677d3fb tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:44:03.107891 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-22d449fc-5e41-49ee-ba06-79954677d3fb tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:44:03.143533 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-5e29d102-6050-44dc-b120-1070c3449548 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:44:03.144176 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-5e29d102-6050-44dc-b120-1070c3449548 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] [instance: ce3b66f8-03e9-4d5f-8c40-d1a887b12304] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:44:03.151343 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-5e29d102-6050-44dc-b120-1070c3449548 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:44:03.151817 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-5e29d102-6050-44dc-b120-1070c3449548 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:44:03.153033 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-5e29d102-6050-44dc-b120-1070c3449548 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:44:03.153551 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-5e29d102-6050-44dc-b120-1070c3449548 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:44:03.154379 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-22d449fc-5e41-49ee-ba06-79954677d3fb tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] [instance: bd2981c6-1a22-4f44-9154-170abe988e75] Going to try to terminate instance {{(pid=129350) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 06 10:44:03.243396 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-22d449fc-5e41-49ee-ba06-79954677d3fb tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] 10.222.0.42 "DELETE /compute/v2.1/servers/bd2981c6-1a22-4f44-9154-170abe988e75" status: 204 len: 0 microversion: 2.1 time: 0.170424 Jun 06 10:44:03.244808 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 332/681] 10.222.0.42 () {58 vars in 1238 bytes} [Mon Jun 6 10:44:03 2022] DELETE /compute/v2.1/servers/bd2981c6-1a22-4f44-9154-170abe988e75 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 06 10:44:03.260152 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-9a2c9d4a-c53a-4747-b450-84f2c3d94538 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:44:03.260932 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-9a2c9d4a-c53a-4747-b450-84f2c3d94538 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] [instance: bd2981c6-1a22-4f44-9154-170abe988e75] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:44:03.274041 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-9a2c9d4a-c53a-4747-b450-84f2c3d94538 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:44:03.276064 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-9a2c9d4a-c53a-4747-b450-84f2c3d94538 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:44:03.278617 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-9a2c9d4a-c53a-4747-b450-84f2c3d94538 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:44:03.279618 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-9a2c9d4a-c53a-4747-b450-84f2c3d94538 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:44:03.342924 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-5e29d102-6050-44dc-b120-1070c3449548 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:44:03.356210 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-5e29d102-6050-44dc-b120-1070c3449548 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:44:03.361519 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-5e29d102-6050-44dc-b120-1070c3449548 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:44:03.366487 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-5e29d102-6050-44dc-b120-1070c3449548 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] 10.222.0.42 "GET /compute/v2.1/servers/ce3b66f8-03e9-4d5f-8c40-d1a887b12304" status: 200 len: 1737 microversion: 2.20 time: 0.224263 Jun 06 10:44:03.367103 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 350/682] 10.222.0.42 () {60 vars in 1276 bytes} [Mon Jun 6 10:44:03 2022] GET /compute/v2.1/servers/ce3b66f8-03e9-4d5f-8c40-d1a887b12304 => generated 1737 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 06 10:44:03.436721 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-9a2c9d4a-c53a-4747-b450-84f2c3d94538 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b7d82c999646b6b6b96d565f0e3f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe30c756a2f84166ad23af1edf83157e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:44:03.445195 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-9a2c9d4a-c53a-4747-b450-84f2c3d94538 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] 10.222.0.42 "GET /compute/v2.1/servers/bd2981c6-1a22-4f44-9154-170abe988e75" status: 200 len: 1672 microversion: 2.1 time: 0.194782 Jun 06 10:44:03.445802 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 333/683] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:44:03 2022] GET /compute/v2.1/servers/bd2981c6-1a22-4f44-9154-170abe988e75 => generated 1672 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:44:04.392469 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-c1406b61-9bfb-4c96-82d0-70bf44f18cc7 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:44:04.393726 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-c1406b61-9bfb-4c96-82d0-70bf44f18cc7 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] [instance: ce3b66f8-03e9-4d5f-8c40-d1a887b12304] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:44:04.400851 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-c1406b61-9bfb-4c96-82d0-70bf44f18cc7 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:44:04.401398 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-c1406b61-9bfb-4c96-82d0-70bf44f18cc7 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:44:04.402879 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-c1406b61-9bfb-4c96-82d0-70bf44f18cc7 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:44:04.403376 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-c1406b61-9bfb-4c96-82d0-70bf44f18cc7 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:44:04.462496 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-aa149a0b-b120-491a-8863-c496a764691b tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:44:04.463204 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-aa149a0b-b120-491a-8863-c496a764691b tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] [instance: bd2981c6-1a22-4f44-9154-170abe988e75] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:44:04.473800 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-aa149a0b-b120-491a-8863-c496a764691b tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:44:04.474578 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-aa149a0b-b120-491a-8863-c496a764691b tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:44:04.475545 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-aa149a0b-b120-491a-8863-c496a764691b tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:44:04.476154 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-aa149a0b-b120-491a-8863-c496a764691b tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:44:04.612088 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-c1406b61-9bfb-4c96-82d0-70bf44f18cc7 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:44:04.620396 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-c1406b61-9bfb-4c96-82d0-70bf44f18cc7 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:44:04.622926 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-c1406b61-9bfb-4c96-82d0-70bf44f18cc7 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:44:04.624965 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-c1406b61-9bfb-4c96-82d0-70bf44f18cc7 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] 10.222.0.42 "GET /compute/v2.1/servers/ce3b66f8-03e9-4d5f-8c40-d1a887b12304" status: 200 len: 1737 microversion: 2.20 time: 0.240797 Jun 06 10:44:04.625618 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 351/684] 10.222.0.42 () {60 vars in 1276 bytes} [Mon Jun 6 10:44:04 2022] GET /compute/v2.1/servers/ce3b66f8-03e9-4d5f-8c40-d1a887b12304 => generated 1737 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 10:44:04.656624 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-aa149a0b-b120-491a-8863-c496a764691b tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b7d82c999646b6b6b96d565f0e3f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe30c756a2f84166ad23af1edf83157e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:44:04.664565 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-aa149a0b-b120-491a-8863-c496a764691b tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] 10.222.0.42 "GET /compute/v2.1/servers/bd2981c6-1a22-4f44-9154-170abe988e75" status: 200 len: 1672 microversion: 2.1 time: 0.205905 Jun 06 10:44:04.673849 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 334/685] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:44:04 2022] GET /compute/v2.1/servers/bd2981c6-1a22-4f44-9154-170abe988e75 => generated 1672 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 10:44:05.646083 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-9ffa245f-7072-4b59-95c7-49a36ed00697 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:44:05.646773 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-9ffa245f-7072-4b59-95c7-49a36ed00697 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] [instance: ce3b66f8-03e9-4d5f-8c40-d1a887b12304] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:44:05.654449 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-9ffa245f-7072-4b59-95c7-49a36ed00697 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:44:05.654884 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-9ffa245f-7072-4b59-95c7-49a36ed00697 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:44:05.655634 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-9ffa245f-7072-4b59-95c7-49a36ed00697 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:44:05.658213 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-9ffa245f-7072-4b59-95c7-49a36ed00697 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:44:05.687454 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-6c6650e5-24fb-4d75-8805-e5e8eea5e2de tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:44:05.688199 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-6c6650e5-24fb-4d75-8805-e5e8eea5e2de tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] [instance: bd2981c6-1a22-4f44-9154-170abe988e75] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:44:05.706895 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-6c6650e5-24fb-4d75-8805-e5e8eea5e2de tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:44:05.707371 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-6c6650e5-24fb-4d75-8805-e5e8eea5e2de tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:44:05.708158 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-6c6650e5-24fb-4d75-8805-e5e8eea5e2de tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:44:05.708595 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-6c6650e5-24fb-4d75-8805-e5e8eea5e2de tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:44:06.210152 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-6c6650e5-24fb-4d75-8805-e5e8eea5e2de tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b7d82c999646b6b6b96d565f0e3f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe30c756a2f84166ad23af1edf83157e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:44:06.219028 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-6c6650e5-24fb-4d75-8805-e5e8eea5e2de tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] 10.222.0.42 "GET /compute/v2.1/servers/bd2981c6-1a22-4f44-9154-170abe988e75" status: 200 len: 1672 microversion: 2.1 time: 0.540606 Jun 06 10:44:06.232501 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-9ffa245f-7072-4b59-95c7-49a36ed00697 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:44:06.236545 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 335/686] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:44:05 2022] GET /compute/v2.1/servers/bd2981c6-1a22-4f44-9154-170abe988e75 => generated 1672 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 10:44:06.242510 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-9ffa245f-7072-4b59-95c7-49a36ed00697 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:44:06.243619 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-9ffa245f-7072-4b59-95c7-49a36ed00697 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:44:06.246123 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-9ffa245f-7072-4b59-95c7-49a36ed00697 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] 10.222.0.42 "GET /compute/v2.1/servers/ce3b66f8-03e9-4d5f-8c40-d1a887b12304" status: 200 len: 1737 microversion: 2.20 time: 0.602724 Jun 06 10:44:06.254520 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 352/687] 10.222.0.42 () {60 vars in 1276 bytes} [Mon Jun 6 10:44:05 2022] GET /compute/v2.1/servers/ce3b66f8-03e9-4d5f-8c40-d1a887b12304 => generated 1737 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 10:44:06.778367 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [req-3ad6f5f3-4e32-4d4d-9908-b2acba3acecf req-6c507a41-c43a-4ca9-9669-ce82ed9cbe95 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd2981c6-1a22-4f44-9154-170abe988e75", "name": "network-vif-deleted", "tag": "5ef175b9-9b1b-4063-a996-b0636718122b"}]} {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 10:44:06.805755 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [req-3ad6f5f3-4e32-4d4d-9908-b2acba3acecf req-6c507a41-c43a-4ca9-9669-ce82ed9cbe95 service nova] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:44:06.806252 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [req-3ad6f5f3-4e32-4d4d-9908-b2acba3acecf req-6c507a41-c43a-4ca9-9669-ce82ed9cbe95 service nova] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:44:06.830235 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.compute.server_external_events [req-3ad6f5f3-4e32-4d4d-9908-b2acba3acecf req-6c507a41-c43a-4ca9-9669-ce82ed9cbe95 service nova] Creating event network-vif-deleted:5ef175b9-9b1b-4063-a996-b0636718122b for instance bd2981c6-1a22-4f44-9154-170abe988e75 on hv-cinder-84482 Jun 06 10:44:06.836795 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [req-3ad6f5f3-4e32-4d4d-9908-b2acba3acecf req-6c507a41-c43a-4ca9-9669-ce82ed9cbe95 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062591 Jun 06 10:44:06.844055 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 336/688] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Jun 6 10:44:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 10:44:07.242036 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-3958bfe6-2b80-4a81-a956-a6a38328f790 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:44:07.242827 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-3958bfe6-2b80-4a81-a956-a6a38328f790 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] [instance: bd2981c6-1a22-4f44-9154-170abe988e75] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:44:07.256514 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-3958bfe6-2b80-4a81-a956-a6a38328f790 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:44:07.257718 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-3958bfe6-2b80-4a81-a956-a6a38328f790 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:44:07.259191 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-3958bfe6-2b80-4a81-a956-a6a38328f790 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:44:07.263331 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-3958bfe6-2b80-4a81-a956-a6a38328f790 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:44:07.268399 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-5b509b6b-f07a-436f-86d4-7d4ad67fdf85 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:44:07.270421 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-5b509b6b-f07a-436f-86d4-7d4ad67fdf85 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] [instance: ce3b66f8-03e9-4d5f-8c40-d1a887b12304] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:44:07.283541 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-5b509b6b-f07a-436f-86d4-7d4ad67fdf85 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:44:07.285148 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-5b509b6b-f07a-436f-86d4-7d4ad67fdf85 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:44:07.286493 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-5b509b6b-f07a-436f-86d4-7d4ad67fdf85 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:44:07.286938 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-5b509b6b-f07a-436f-86d4-7d4ad67fdf85 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:44:07.310341 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-3958bfe6-2b80-4a81-a956-a6a38328f790 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:44:07.312339 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-3958bfe6-2b80-4a81-a956-a6a38328f790 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:44:07.313554 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.objects.instance [None req-3958bfe6-2b80-4a81-a956-a6a38328f790 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lazy-loading 'fault' on Instance uuid bd2981c6-1a22-4f44-9154-170abe988e75 {{(pid=129349) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 06 10:44:07.376097 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-3958bfe6-2b80-4a81-a956-a6a38328f790 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b7d82c999646b6b6b96d565f0e3f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe30c756a2f84166ad23af1edf83157e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:44:07.400181 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-3958bfe6-2b80-4a81-a956-a6a38328f790 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] 10.222.0.42 "GET /compute/v2.1/servers/bd2981c6-1a22-4f44-9154-170abe988e75" status: 200 len: 1327 microversion: 2.1 time: 0.166515 Jun 06 10:44:07.410274 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 353/689] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:44:07 2022] GET /compute/v2.1/servers/bd2981c6-1a22-4f44-9154-170abe988e75 => generated 1327 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:44:07.506048 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-5b509b6b-f07a-436f-86d4-7d4ad67fdf85 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:44:07.515795 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-5b509b6b-f07a-436f-86d4-7d4ad67fdf85 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:44:07.518936 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-5b509b6b-f07a-436f-86d4-7d4ad67fdf85 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:44:07.520162 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-5b509b6b-f07a-436f-86d4-7d4ad67fdf85 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] 10.222.0.42 "GET /compute/v2.1/servers/ce3b66f8-03e9-4d5f-8c40-d1a887b12304" status: 200 len: 1737 microversion: 2.20 time: 0.257326 Jun 06 10:44:07.532580 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 337/690] 10.222.0.42 () {60 vars in 1276 bytes} [Mon Jun 6 10:44:07 2022] GET /compute/v2.1/servers/ce3b66f8-03e9-4d5f-8c40-d1a887b12304 => generated 1737 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 10:44:08.431710 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-cebaf903-a552-402f-90ba-5db506914f34 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:44:08.432463 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-cebaf903-a552-402f-90ba-5db506914f34 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] [instance: bd2981c6-1a22-4f44-9154-170abe988e75] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:44:08.440147 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-cebaf903-a552-402f-90ba-5db506914f34 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:44:08.440693 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-cebaf903-a552-402f-90ba-5db506914f34 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:44:08.446265 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-cebaf903-a552-402f-90ba-5db506914f34 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:44:08.447474 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-cebaf903-a552-402f-90ba-5db506914f34 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:44:08.469269 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.wsgi [None req-cebaf903-a552-402f-90ba-5db506914f34 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] HTTP exception thrown: Instance bd2981c6-1a22-4f44-9154-170abe988e75 could not be found. Jun 06 10:44:08.471420 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-cebaf903-a552-402f-90ba-5db506914f34 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Request method failure captured: Jun 06 10:44:08.471420 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: request: GET /compute/v2.1/servers/bd2981c6-1a22-4f44-9154-170abe988e75 HTTP/1.1 Jun 06 10:44:08.471420 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: Accept: application/json Jun 06 10:44:08.471420 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: Accept-Encoding: identity Jun 06 10:44:08.471420 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: Connection: close Jun 06 10:44:08.471420 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: Content-Length: 0 Jun 06 10:44:08.471420 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: Content-Type: application/json Jun 06 10:44:08.471420 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: Host: 10.222.0.42 Jun 06 10:44:08.471420 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: Openstack-System-Scope: None Jun 06 10:44:08.471420 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: User-Agent: python-urllib3/1.26.9 Jun 06 10:44:08.471420 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Auth-Token: gAAAAABindkVPjrYNfw4lPsEvV1DBkHMzfkzFcyl0PyTEflxsUZ_Idryl7a4K8E8CJs1-vn_w0uzUKdIkJQlPXesaauws6VIJTys9Kf8RqH7iedIpqv26wdHSTgW5jSML0WcIhjjHUbF_ZfSWrR7_BgUv3p0oLs7MsYkczQVx5aDUHcMInlAF3U Jun 06 10:44:08.471420 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Domain-Id: None Jun 06 10:44:08.471420 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Domain-Name: None Jun 06 10:44:08.471420 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Identity-Status: Confirmed Jun 06 10:44:08.471420 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Is-Admin-Project: True Jun 06 10:44:08.471420 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Project-Domain-Id: default Jun 06 10:44:08.471420 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Project-Domain-Name: Default Jun 06 10:44:08.471420 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Project-Id: fe30c756a2f84166ad23af1edf83157e Jun 06 10:44:08.471420 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Project-Name: tempest-AttachVolumeTestJSON-489641414 Jun 06 10:44:08.471420 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Role: member,reader Jun 06 10:44:08.471420 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Roles: member,reader Jun 06 10:44:08.473060 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/fe30c756a2f84166ad23af1edf83157e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/fe30c756a2f84166ad23af1edf83157e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/fe30c756a2f84166ad23af1edf83157e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_fe30c756a2f84166ad23af1edf83157e", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Jun 06 10:44:08.473060 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Tenant: tempest-AttachVolumeTestJSON-489641414 Jun 06 10:44:08.473060 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Tenant-Id: fe30c756a2f84166ad23af1edf83157e Jun 06 10:44:08.473060 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Tenant-Name: tempest-AttachVolumeTestJSON-489641414 Jun 06 10:44:08.473060 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-User: tempest-AttachVolumeTestJSON-489641414-project Jun 06 10:44:08.473060 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-User-Domain-Id: default Jun 06 10:44:08.473060 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-User-Domain-Name: Default Jun 06 10:44:08.473060 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-User-Id: f6b7d82c999646b6b6b96d565f0e3f9a Jun 06 10:44:08.473060 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-User-Name: tempest-AttachVolumeTestJSON-489641414-project Jun 06 10:44:08.473060 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: method: > Jun 06 10:44:08.473060 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: exception: Instance bd2981c6-1a22-4f44-9154-170abe988e75 could not be found. Jun 06 10:44:08.473060 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: action_args: {'id': 'bd2981c6-1a22-4f44-9154-170abe988e75'} Jun 06 10:44:08.473975 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 10:44:08.473975 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 10:44:08.473975 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 06 10:44:08.473975 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 06 10:44:08.473975 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 06 10:44:08.473975 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 06 10:44:08.473975 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 06 10:44:08.473975 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 06 10:44:08.473975 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 06 10:44:08.473975 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 06 10:44:08.473975 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bd2981c6-1a22-4f44-9154-170abe988e75 could not be found. Jun 06 10:44:08.473975 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Jun 06 10:44:08.473975 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 10:44:08.473975 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Jun 06 10:44:08.473975 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 10:44:08.473975 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 10:44:08.473975 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 10:44:08.473975 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 10:44:08.473975 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 10:44:08.473975 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 10:44:08.475468 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 10:44:08.475468 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 06 10:44:08.475468 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 06 10:44:08.475468 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 06 10:44:08.475468 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 06 10:44:08.475468 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 06 10:44:08.475468 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 06 10:44:08.475468 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bd2981c6-1a22-4f44-9154-170abe988e75 could not be found. Jun 06 10:44:08.475468 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Jun 06 10:44:08.475468 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 10:44:08.475468 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Jun 06 10:44:08.475468 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 10:44:08.475468 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 10:44:08.475468 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 10:44:08.475468 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 10:44:08.475468 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 10:44:08.475468 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bd2981c6-1a22-4f44-9154-170abe988e75 could not be found. Jun 06 10:44:08.475468 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Jun 06 10:44:08.477461 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-cebaf903-a552-402f-90ba-5db506914f34 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Returning 404 to user: Instance bd2981c6-1a22-4f44-9154-170abe988e75 could not be found. {{(pid=129349) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 10:44:08.478460 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-cebaf903-a552-402f-90ba-5db506914f34 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] 10.222.0.42 "GET /compute/v2.1/servers/bd2981c6-1a22-4f44-9154-170abe988e75" status: 404 len: 111 microversion: 2.1 time: 0.051700 Jun 06 10:44:08.479509 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 354/691] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:44:08 2022] GET /compute/v2.1/servers/bd2981c6-1a22-4f44-9154-170abe988e75 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 06 10:44:08.488751 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-b9d96919-24fd-4b33-b587-37d5bd1fdeb0 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Calling method '.version_select at 0x7f8fd37e0e50>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:44:08.512805 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-b9d96919-24fd-4b33-b587-37d5bd1fdeb0 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1685981692" status: 202 len: 0 microversion: 2.1 time: 0.026670 Jun 06 10:44:08.515750 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 338/692] 10.222.0.42 () {58 vars in 1220 bytes} [Mon Jun 6 10:44:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1685981692 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 06 10:44:08.539243 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-3af2381e-838b-4409-bb32-351a3bfb09de tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:44:08.540174 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-3af2381e-838b-4409-bb32-351a3bfb09de tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] [instance: ce3b66f8-03e9-4d5f-8c40-d1a887b12304] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:44:08.550632 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-3af2381e-838b-4409-bb32-351a3bfb09de tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:44:08.552040 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-3af2381e-838b-4409-bb32-351a3bfb09de tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:44:08.554195 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-3af2381e-838b-4409-bb32-351a3bfb09de tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:44:08.555617 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-3af2381e-838b-4409-bb32-351a3bfb09de tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:44:08.774014 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-3af2381e-838b-4409-bb32-351a3bfb09de tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:44:08.787656 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-3af2381e-838b-4409-bb32-351a3bfb09de tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:44:08.798382 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-3af2381e-838b-4409-bb32-351a3bfb09de tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:44:08.800944 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-3af2381e-838b-4409-bb32-351a3bfb09de tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] 10.222.0.42 "GET /compute/v2.1/servers/ce3b66f8-03e9-4d5f-8c40-d1a887b12304" status: 200 len: 1737 microversion: 2.20 time: 0.266305 Jun 06 10:44:08.802296 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 355/693] 10.222.0.42 () {60 vars in 1276 bytes} [Mon Jun 6 10:44:08 2022] GET /compute/v2.1/servers/ce3b66f8-03e9-4d5f-8c40-d1a887b12304 => generated 1737 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 06 10:44:09.820725 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-53a2a79b-1316-46a6-8d59-a6f9feaf5f52 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:44:09.821338 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-53a2a79b-1316-46a6-8d59-a6f9feaf5f52 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] [instance: ce3b66f8-03e9-4d5f-8c40-d1a887b12304] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:44:09.825026 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG dbcounter [-] [129350] Writing DB stats nova_api:SELECT=60,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=129350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 10:44:09.840191 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-53a2a79b-1316-46a6-8d59-a6f9feaf5f52 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:44:09.840965 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-53a2a79b-1316-46a6-8d59-a6f9feaf5f52 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:44:09.842053 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-53a2a79b-1316-46a6-8d59-a6f9feaf5f52 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:44:09.842522 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-53a2a79b-1316-46a6-8d59-a6f9feaf5f52 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:44:10.132708 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-53a2a79b-1316-46a6-8d59-a6f9feaf5f52 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:44:10.145821 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-53a2a79b-1316-46a6-8d59-a6f9feaf5f52 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:44:10.148494 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-53a2a79b-1316-46a6-8d59-a6f9feaf5f52 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:44:10.150135 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-53a2a79b-1316-46a6-8d59-a6f9feaf5f52 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] 10.222.0.42 "GET /compute/v2.1/servers/ce3b66f8-03e9-4d5f-8c40-d1a887b12304" status: 200 len: 1737 microversion: 2.20 time: 0.334148 Jun 06 10:44:10.162680 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 339/694] 10.222.0.42 () {60 vars in 1276 bytes} [Mon Jun 6 10:44:09 2022] GET /compute/v2.1/servers/ce3b66f8-03e9-4d5f-8c40-d1a887b12304 => generated 1737 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 10:44:11.169831 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-6d7d0c79-56da-42c4-b9d6-8e0de1d1516a tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:44:11.170516 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-6d7d0c79-56da-42c4-b9d6-8e0de1d1516a tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] [instance: ce3b66f8-03e9-4d5f-8c40-d1a887b12304] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:44:11.173744 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG dbcounter [-] [129349] Writing DB stats nova_api:SELECT=56 {{(pid=129349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 10:44:11.179126 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-6d7d0c79-56da-42c4-b9d6-8e0de1d1516a tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:44:11.179614 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-6d7d0c79-56da-42c4-b9d6-8e0de1d1516a tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:44:11.180436 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-6d7d0c79-56da-42c4-b9d6-8e0de1d1516a tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:44:11.180882 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-6d7d0c79-56da-42c4-b9d6-8e0de1d1516a tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:44:11.396629 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-6d7d0c79-56da-42c4-b9d6-8e0de1d1516a tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:44:11.404743 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-6d7d0c79-56da-42c4-b9d6-8e0de1d1516a tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:44:11.406281 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-6d7d0c79-56da-42c4-b9d6-8e0de1d1516a tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:44:11.407438 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-6d7d0c79-56da-42c4-b9d6-8e0de1d1516a tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] 10.222.0.42 "GET /compute/v2.1/servers/ce3b66f8-03e9-4d5f-8c40-d1a887b12304" status: 200 len: 1719 microversion: 2.20 time: 0.241796 Jun 06 10:44:11.408028 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 356/695] 10.222.0.42 () {60 vars in 1276 bytes} [Mon Jun 6 10:44:11 2022] GET /compute/v2.1/servers/ce3b66f8-03e9-4d5f-8c40-d1a887b12304 => generated 1719 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 06 10:44:12.111838 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-fc0d3751-eac1-4b84-9305-8a4e5dd48226 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:44:12.112410 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-fc0d3751-eac1-4b84-9305-8a4e5dd48226 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] [instance: bd2981c6-1a22-4f44-9154-170abe988e75] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:44:12.119020 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-fc0d3751-eac1-4b84-9305-8a4e5dd48226 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:44:12.119467 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-fc0d3751-eac1-4b84-9305-8a4e5dd48226 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:44:12.120302 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-fc0d3751-eac1-4b84-9305-8a4e5dd48226 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:44:12.120735 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-fc0d3751-eac1-4b84-9305-8a4e5dd48226 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:44:12.133796 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.wsgi [None req-fc0d3751-eac1-4b84-9305-8a4e5dd48226 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] HTTP exception thrown: Instance bd2981c6-1a22-4f44-9154-170abe988e75 could not be found. Jun 06 10:44:12.135431 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-fc0d3751-eac1-4b84-9305-8a4e5dd48226 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Request method failure captured: Jun 06 10:44:12.135431 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: request: DELETE /compute/v2.1/servers/bd2981c6-1a22-4f44-9154-170abe988e75 HTTP/1.1 Jun 06 10:44:12.135431 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: Accept: application/json Jun 06 10:44:12.135431 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: Accept-Encoding: identity Jun 06 10:44:12.135431 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: Connection: close Jun 06 10:44:12.135431 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: Content-Length: 0 Jun 06 10:44:12.135431 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: Content-Type: application/json Jun 06 10:44:12.135431 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: Host: 10.222.0.42 Jun 06 10:44:12.135431 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: Openstack-System-Scope: None Jun 06 10:44:12.135431 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: User-Agent: python-urllib3/1.26.9 Jun 06 10:44:12.135431 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Auth-Token: gAAAAABindkVPjrYNfw4lPsEvV1DBkHMzfkzFcyl0PyTEflxsUZ_Idryl7a4K8E8CJs1-vn_w0uzUKdIkJQlPXesaauws6VIJTys9Kf8RqH7iedIpqv26wdHSTgW5jSML0WcIhjjHUbF_ZfSWrR7_BgUv3p0oLs7MsYkczQVx5aDUHcMInlAF3U Jun 06 10:44:12.135431 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Domain-Id: None Jun 06 10:44:12.135431 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Domain-Name: None Jun 06 10:44:12.135431 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Identity-Status: Confirmed Jun 06 10:44:12.135431 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Is-Admin-Project: True Jun 06 10:44:12.135431 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Project-Domain-Id: default Jun 06 10:44:12.135431 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Project-Domain-Name: Default Jun 06 10:44:12.135431 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Project-Id: fe30c756a2f84166ad23af1edf83157e Jun 06 10:44:12.135431 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Project-Name: tempest-AttachVolumeTestJSON-489641414 Jun 06 10:44:12.135431 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Role: member,reader Jun 06 10:44:12.135431 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Roles: member,reader Jun 06 10:44:12.137056 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/fe30c756a2f84166ad23af1edf83157e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/fe30c756a2f84166ad23af1edf83157e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/fe30c756a2f84166ad23af1edf83157e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_fe30c756a2f84166ad23af1edf83157e", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Jun 06 10:44:12.137056 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Tenant: tempest-AttachVolumeTestJSON-489641414 Jun 06 10:44:12.137056 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Tenant-Id: fe30c756a2f84166ad23af1edf83157e Jun 06 10:44:12.137056 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Tenant-Name: tempest-AttachVolumeTestJSON-489641414 Jun 06 10:44:12.137056 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-User: tempest-AttachVolumeTestJSON-489641414-project Jun 06 10:44:12.137056 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-User-Domain-Id: default Jun 06 10:44:12.137056 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-User-Domain-Name: Default Jun 06 10:44:12.137056 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-User-Id: f6b7d82c999646b6b6b96d565f0e3f9a Jun 06 10:44:12.137056 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-User-Name: tempest-AttachVolumeTestJSON-489641414-project Jun 06 10:44:12.137056 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: method: > Jun 06 10:44:12.137056 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: exception: Instance bd2981c6-1a22-4f44-9154-170abe988e75 could not be found. Jun 06 10:44:12.137056 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: action_args: {'id': 'bd2981c6-1a22-4f44-9154-170abe988e75'} Jun 06 10:44:12.137957 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 10:44:12.137957 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 10:44:12.137957 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 06 10:44:12.137957 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 06 10:44:12.137957 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 06 10:44:12.137957 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 06 10:44:12.137957 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 06 10:44:12.137957 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 06 10:44:12.137957 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 06 10:44:12.137957 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 06 10:44:12.137957 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bd2981c6-1a22-4f44-9154-170abe988e75 could not be found. Jun 06 10:44:12.137957 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi Jun 06 10:44:12.137957 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 10:44:12.137957 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi Jun 06 10:44:12.137957 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 10:44:12.137957 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 10:44:12.137957 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 10:44:12.137957 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 10:44:12.137957 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 10:44:12.137957 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 10:44:12.139461 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 10:44:12.139461 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 06 10:44:12.139461 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 06 10:44:12.139461 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 06 10:44:12.139461 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 06 10:44:12.139461 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 06 10:44:12.139461 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 06 10:44:12.139461 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 06 10:44:12.139461 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 06 10:44:12.139461 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bd2981c6-1a22-4f44-9154-170abe988e75 could not be found. Jun 06 10:44:12.139461 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi Jun 06 10:44:12.139461 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 10:44:12.139461 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi Jun 06 10:44:12.139461 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 10:44:12.139461 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 10:44:12.139461 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 10:44:12.139461 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 10:44:12.139461 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 10:44:12.139461 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bd2981c6-1a22-4f44-9154-170abe988e75 could not be found. Jun 06 10:44:12.139461 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi Jun 06 10:44:12.141246 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-fc0d3751-eac1-4b84-9305-8a4e5dd48226 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Returning 404 to user: Instance bd2981c6-1a22-4f44-9154-170abe988e75 could not be found. {{(pid=129350) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 10:44:12.141246 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-fc0d3751-eac1-4b84-9305-8a4e5dd48226 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] 10.222.0.42 "DELETE /compute/v2.1/servers/bd2981c6-1a22-4f44-9154-170abe988e75" status: 404 len: 111 microversion: 2.1 time: 0.029152 Jun 06 10:44:12.141246 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 340/696] 10.222.0.42 () {58 vars in 1238 bytes} [Mon Jun 6 10:44:12 2022] DELETE /compute/v2.1/servers/bd2981c6-1a22-4f44-9154-170abe988e75 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 06 10:44:12.146619 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-e4dc310a-d244-4a20-8bbd-b9fb664c2fe6 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:44:12.147228 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-e4dc310a-d244-4a20-8bbd-b9fb664c2fe6 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] [instance: bd2981c6-1a22-4f44-9154-170abe988e75] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:44:12.154090 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-e4dc310a-d244-4a20-8bbd-b9fb664c2fe6 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:44:12.154531 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-e4dc310a-d244-4a20-8bbd-b9fb664c2fe6 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:44:12.155289 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-e4dc310a-d244-4a20-8bbd-b9fb664c2fe6 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:44:12.155718 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-e4dc310a-d244-4a20-8bbd-b9fb664c2fe6 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:44:12.169545 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.wsgi [None req-e4dc310a-d244-4a20-8bbd-b9fb664c2fe6 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] HTTP exception thrown: Instance bd2981c6-1a22-4f44-9154-170abe988e75 could not be found. Jun 06 10:44:12.171140 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-e4dc310a-d244-4a20-8bbd-b9fb664c2fe6 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Request method failure captured: Jun 06 10:44:12.171140 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: request: GET /compute/v2.1/servers/bd2981c6-1a22-4f44-9154-170abe988e75 HTTP/1.1 Jun 06 10:44:12.171140 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: Accept: application/json Jun 06 10:44:12.171140 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: Accept-Encoding: identity Jun 06 10:44:12.171140 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: Connection: close Jun 06 10:44:12.171140 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: Content-Length: 0 Jun 06 10:44:12.171140 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: Content-Type: application/json Jun 06 10:44:12.171140 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: Host: 10.222.0.42 Jun 06 10:44:12.171140 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: Openstack-System-Scope: None Jun 06 10:44:12.171140 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: User-Agent: python-urllib3/1.26.9 Jun 06 10:44:12.171140 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Auth-Token: gAAAAABindkVPjrYNfw4lPsEvV1DBkHMzfkzFcyl0PyTEflxsUZ_Idryl7a4K8E8CJs1-vn_w0uzUKdIkJQlPXesaauws6VIJTys9Kf8RqH7iedIpqv26wdHSTgW5jSML0WcIhjjHUbF_ZfSWrR7_BgUv3p0oLs7MsYkczQVx5aDUHcMInlAF3U Jun 06 10:44:12.171140 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Domain-Id: None Jun 06 10:44:12.171140 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Domain-Name: None Jun 06 10:44:12.171140 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Identity-Status: Confirmed Jun 06 10:44:12.171140 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Is-Admin-Project: True Jun 06 10:44:12.171140 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Project-Domain-Id: default Jun 06 10:44:12.171140 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Project-Domain-Name: Default Jun 06 10:44:12.171140 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Project-Id: fe30c756a2f84166ad23af1edf83157e Jun 06 10:44:12.171140 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Project-Name: tempest-AttachVolumeTestJSON-489641414 Jun 06 10:44:12.171140 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Role: member,reader Jun 06 10:44:12.171140 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Roles: member,reader Jun 06 10:44:12.173131 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/fe30c756a2f84166ad23af1edf83157e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/fe30c756a2f84166ad23af1edf83157e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/fe30c756a2f84166ad23af1edf83157e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_fe30c756a2f84166ad23af1edf83157e", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Jun 06 10:44:12.173131 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Tenant: tempest-AttachVolumeTestJSON-489641414 Jun 06 10:44:12.173131 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Tenant-Id: fe30c756a2f84166ad23af1edf83157e Jun 06 10:44:12.173131 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Tenant-Name: tempest-AttachVolumeTestJSON-489641414 Jun 06 10:44:12.173131 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-User: tempest-AttachVolumeTestJSON-489641414-project Jun 06 10:44:12.173131 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-User-Domain-Id: default Jun 06 10:44:12.173131 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-User-Domain-Name: Default Jun 06 10:44:12.173131 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-User-Id: f6b7d82c999646b6b6b96d565f0e3f9a Jun 06 10:44:12.173131 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-User-Name: tempest-AttachVolumeTestJSON-489641414-project Jun 06 10:44:12.173131 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: method: > Jun 06 10:44:12.173131 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: exception: Instance bd2981c6-1a22-4f44-9154-170abe988e75 could not be found. Jun 06 10:44:12.173131 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: action_args: {'id': 'bd2981c6-1a22-4f44-9154-170abe988e75'} Jun 06 10:44:12.173841 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 10:44:12.173841 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 10:44:12.173841 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 06 10:44:12.173841 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 06 10:44:12.173841 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 06 10:44:12.173841 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 06 10:44:12.173841 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 06 10:44:12.173841 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 06 10:44:12.173841 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 06 10:44:12.173841 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 06 10:44:12.173841 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bd2981c6-1a22-4f44-9154-170abe988e75 could not be found. Jun 06 10:44:12.173841 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Jun 06 10:44:12.173841 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 10:44:12.173841 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Jun 06 10:44:12.173841 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 10:44:12.173841 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 10:44:12.173841 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 10:44:12.173841 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 10:44:12.173841 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 10:44:12.173841 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 10:44:12.174977 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 10:44:12.174977 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 06 10:44:12.174977 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 06 10:44:12.174977 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 06 10:44:12.174977 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 06 10:44:12.174977 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 06 10:44:12.174977 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 06 10:44:12.174977 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bd2981c6-1a22-4f44-9154-170abe988e75 could not be found. Jun 06 10:44:12.174977 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Jun 06 10:44:12.174977 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 10:44:12.174977 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Jun 06 10:44:12.174977 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 10:44:12.174977 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 10:44:12.174977 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 10:44:12.174977 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 10:44:12.174977 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 10:44:12.174977 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bd2981c6-1a22-4f44-9154-170abe988e75 could not be found. Jun 06 10:44:12.174977 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Jun 06 10:44:12.176101 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-e4dc310a-d244-4a20-8bbd-b9fb664c2fe6 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Returning 404 to user: Instance bd2981c6-1a22-4f44-9154-170abe988e75 could not be found. {{(pid=129349) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 10:44:12.176101 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-e4dc310a-d244-4a20-8bbd-b9fb664c2fe6 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] 10.222.0.42 "GET /compute/v2.1/servers/bd2981c6-1a22-4f44-9154-170abe988e75" status: 404 len: 111 microversion: 2.1 time: 0.029761 Jun 06 10:44:12.176101 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 357/697] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:44:12 2022] GET /compute/v2.1/servers/bd2981c6-1a22-4f44-9154-170abe988e75 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 06 10:44:12.426240 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-f4da7bce-1cbf-4282-b639-ebb725086934 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:44:12.426877 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-f4da7bce-1cbf-4282-b639-ebb725086934 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] [instance: ce3b66f8-03e9-4d5f-8c40-d1a887b12304] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:44:12.432843 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-f4da7bce-1cbf-4282-b639-ebb725086934 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:44:12.433289 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-f4da7bce-1cbf-4282-b639-ebb725086934 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:44:12.434074 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-f4da7bce-1cbf-4282-b639-ebb725086934 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:44:12.434666 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-f4da7bce-1cbf-4282-b639-ebb725086934 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:44:12.563650 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-f4da7bce-1cbf-4282-b639-ebb725086934 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:44:12.571466 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-f4da7bce-1cbf-4282-b639-ebb725086934 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:44:12.572991 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-f4da7bce-1cbf-4282-b639-ebb725086934 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:44:12.574794 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-f4da7bce-1cbf-4282-b639-ebb725086934 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] 10.222.0.42 "GET /compute/v2.1/servers/ce3b66f8-03e9-4d5f-8c40-d1a887b12304" status: 200 len: 1719 microversion: 2.20 time: 0.152835 Jun 06 10:44:12.575338 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 341/698] 10.222.0.42 () {60 vars in 1276 bytes} [Mon Jun 6 10:44:12 2022] GET /compute/v2.1/servers/ce3b66f8-03e9-4d5f-8c40-d1a887b12304 => generated 1719 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 10:44:13.303590 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-1d35da10-d8d8-4806-917b-5fb99e4d4483 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:44:13.304902 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-1d35da10-d8d8-4806-917b-5fb99e4d4483 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] [instance: f49079c1-1384-4136-b6cf-eadc40fb5aa1] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:44:13.312340 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-1d35da10-d8d8-4806-917b-5fb99e4d4483 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:44:13.312781 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-1d35da10-d8d8-4806-917b-5fb99e4d4483 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:44:13.313565 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-1d35da10-d8d8-4806-917b-5fb99e4d4483 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:44:13.314071 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-1d35da10-d8d8-4806-917b-5fb99e4d4483 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:44:13.327979 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.wsgi [None req-1d35da10-d8d8-4806-917b-5fb99e4d4483 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] HTTP exception thrown: Instance f49079c1-1384-4136-b6cf-eadc40fb5aa1 could not be found. Jun 06 10:44:13.329568 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-1d35da10-d8d8-4806-917b-5fb99e4d4483 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Request method failure captured: Jun 06 10:44:13.329568 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: request: DELETE /compute/v2.1/servers/f49079c1-1384-4136-b6cf-eadc40fb5aa1 HTTP/1.1 Jun 06 10:44:13.329568 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: Accept: application/json Jun 06 10:44:13.329568 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: Accept-Encoding: identity Jun 06 10:44:13.329568 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: Connection: close Jun 06 10:44:13.329568 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: Content-Length: 0 Jun 06 10:44:13.329568 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: Content-Type: application/json Jun 06 10:44:13.329568 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: Host: 10.222.0.42 Jun 06 10:44:13.329568 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: Openstack-System-Scope: None Jun 06 10:44:13.329568 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: User-Agent: python-urllib3/1.26.9 Jun 06 10:44:13.329568 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Auth-Token: gAAAAABindkVPjrYNfw4lPsEvV1DBkHMzfkzFcyl0PyTEflxsUZ_Idryl7a4K8E8CJs1-vn_w0uzUKdIkJQlPXesaauws6VIJTys9Kf8RqH7iedIpqv26wdHSTgW5jSML0WcIhjjHUbF_ZfSWrR7_BgUv3p0oLs7MsYkczQVx5aDUHcMInlAF3U Jun 06 10:44:13.329568 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Domain-Id: None Jun 06 10:44:13.329568 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Domain-Name: None Jun 06 10:44:13.329568 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Identity-Status: Confirmed Jun 06 10:44:13.329568 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Is-Admin-Project: True Jun 06 10:44:13.329568 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Project-Domain-Id: default Jun 06 10:44:13.329568 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Project-Domain-Name: Default Jun 06 10:44:13.329568 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Project-Id: fe30c756a2f84166ad23af1edf83157e Jun 06 10:44:13.329568 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Project-Name: tempest-AttachVolumeTestJSON-489641414 Jun 06 10:44:13.329568 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Role: member,reader Jun 06 10:44:13.329568 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Roles: member,reader Jun 06 10:44:13.331268 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/fe30c756a2f84166ad23af1edf83157e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/fe30c756a2f84166ad23af1edf83157e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/fe30c756a2f84166ad23af1edf83157e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_fe30c756a2f84166ad23af1edf83157e", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Jun 06 10:44:13.331268 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Tenant: tempest-AttachVolumeTestJSON-489641414 Jun 06 10:44:13.331268 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Tenant-Id: fe30c756a2f84166ad23af1edf83157e Jun 06 10:44:13.331268 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Tenant-Name: tempest-AttachVolumeTestJSON-489641414 Jun 06 10:44:13.331268 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-User: tempest-AttachVolumeTestJSON-489641414-project Jun 06 10:44:13.331268 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-User-Domain-Id: default Jun 06 10:44:13.331268 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-User-Domain-Name: Default Jun 06 10:44:13.331268 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-User-Id: f6b7d82c999646b6b6b96d565f0e3f9a Jun 06 10:44:13.331268 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-User-Name: tempest-AttachVolumeTestJSON-489641414-project Jun 06 10:44:13.331268 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: method: > Jun 06 10:44:13.331268 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: exception: Instance f49079c1-1384-4136-b6cf-eadc40fb5aa1 could not be found. Jun 06 10:44:13.331268 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: action_args: {'id': 'f49079c1-1384-4136-b6cf-eadc40fb5aa1'} Jun 06 10:44:13.332262 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 10:44:13.332262 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 10:44:13.332262 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 06 10:44:13.332262 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 06 10:44:13.332262 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 06 10:44:13.332262 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 06 10:44:13.332262 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 06 10:44:13.332262 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 06 10:44:13.332262 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 06 10:44:13.332262 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 06 10:44:13.332262 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f49079c1-1384-4136-b6cf-eadc40fb5aa1 could not be found. Jun 06 10:44:13.332262 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Jun 06 10:44:13.332262 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 10:44:13.332262 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Jun 06 10:44:13.332262 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 10:44:13.332262 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 10:44:13.332262 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 10:44:13.332262 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 10:44:13.332262 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 10:44:13.332262 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 10:44:13.334404 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 10:44:13.334404 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 06 10:44:13.334404 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 06 10:44:13.334404 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 06 10:44:13.334404 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 06 10:44:13.334404 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 06 10:44:13.334404 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 06 10:44:13.334404 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 06 10:44:13.334404 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 06 10:44:13.334404 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f49079c1-1384-4136-b6cf-eadc40fb5aa1 could not be found. Jun 06 10:44:13.334404 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Jun 06 10:44:13.334404 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 10:44:13.334404 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Jun 06 10:44:13.334404 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 10:44:13.334404 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 10:44:13.334404 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 10:44:13.334404 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 10:44:13.334404 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 10:44:13.334404 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f49079c1-1384-4136-b6cf-eadc40fb5aa1 could not be found. Jun 06 10:44:13.334404 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Jun 06 10:44:13.336142 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-1d35da10-d8d8-4806-917b-5fb99e4d4483 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Returning 404 to user: Instance f49079c1-1384-4136-b6cf-eadc40fb5aa1 could not be found. {{(pid=129349) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 10:44:13.336142 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-1d35da10-d8d8-4806-917b-5fb99e4d4483 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] 10.222.0.42 "DELETE /compute/v2.1/servers/f49079c1-1384-4136-b6cf-eadc40fb5aa1" status: 404 len: 111 microversion: 2.1 time: 0.031198 Jun 06 10:44:13.336142 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 358/699] 10.222.0.42 () {58 vars in 1238 bytes} [Mon Jun 6 10:44:13 2022] DELETE /compute/v2.1/servers/f49079c1-1384-4136-b6cf-eadc40fb5aa1 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 06 10:44:13.339357 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-b1a3e348-f906-46af-9dbe-400b558d4967 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:44:13.340194 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-b1a3e348-f906-46af-9dbe-400b558d4967 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] [instance: f49079c1-1384-4136-b6cf-eadc40fb5aa1] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:44:13.346481 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-b1a3e348-f906-46af-9dbe-400b558d4967 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:44:13.346929 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-b1a3e348-f906-46af-9dbe-400b558d4967 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:44:13.347701 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-b1a3e348-f906-46af-9dbe-400b558d4967 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:44:13.348165 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-b1a3e348-f906-46af-9dbe-400b558d4967 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:44:13.362100 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.wsgi [None req-b1a3e348-f906-46af-9dbe-400b558d4967 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] HTTP exception thrown: Instance f49079c1-1384-4136-b6cf-eadc40fb5aa1 could not be found. Jun 06 10:44:13.363639 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-b1a3e348-f906-46af-9dbe-400b558d4967 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Request method failure captured: Jun 06 10:44:13.363639 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: request: GET /compute/v2.1/servers/f49079c1-1384-4136-b6cf-eadc40fb5aa1 HTTP/1.1 Jun 06 10:44:13.363639 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: Accept: application/json Jun 06 10:44:13.363639 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: Accept-Encoding: identity Jun 06 10:44:13.363639 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: Connection: close Jun 06 10:44:13.363639 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: Content-Length: 0 Jun 06 10:44:13.363639 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: Content-Type: application/json Jun 06 10:44:13.363639 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: Host: 10.222.0.42 Jun 06 10:44:13.363639 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: Openstack-System-Scope: None Jun 06 10:44:13.363639 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: User-Agent: python-urllib3/1.26.9 Jun 06 10:44:13.363639 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Auth-Token: gAAAAABindkVPjrYNfw4lPsEvV1DBkHMzfkzFcyl0PyTEflxsUZ_Idryl7a4K8E8CJs1-vn_w0uzUKdIkJQlPXesaauws6VIJTys9Kf8RqH7iedIpqv26wdHSTgW5jSML0WcIhjjHUbF_ZfSWrR7_BgUv3p0oLs7MsYkczQVx5aDUHcMInlAF3U Jun 06 10:44:13.363639 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Domain-Id: None Jun 06 10:44:13.363639 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Domain-Name: None Jun 06 10:44:13.363639 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Identity-Status: Confirmed Jun 06 10:44:13.363639 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Is-Admin-Project: True Jun 06 10:44:13.363639 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Project-Domain-Id: default Jun 06 10:44:13.363639 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Project-Domain-Name: Default Jun 06 10:44:13.363639 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Project-Id: fe30c756a2f84166ad23af1edf83157e Jun 06 10:44:13.363639 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Project-Name: tempest-AttachVolumeTestJSON-489641414 Jun 06 10:44:13.363639 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Role: member,reader Jun 06 10:44:13.363639 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Roles: member,reader Jun 06 10:44:13.365355 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/fe30c756a2f84166ad23af1edf83157e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/fe30c756a2f84166ad23af1edf83157e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/fe30c756a2f84166ad23af1edf83157e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_fe30c756a2f84166ad23af1edf83157e", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Jun 06 10:44:13.365355 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Tenant: tempest-AttachVolumeTestJSON-489641414 Jun 06 10:44:13.365355 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Tenant-Id: fe30c756a2f84166ad23af1edf83157e Jun 06 10:44:13.365355 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Tenant-Name: tempest-AttachVolumeTestJSON-489641414 Jun 06 10:44:13.365355 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-User: tempest-AttachVolumeTestJSON-489641414-project Jun 06 10:44:13.365355 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-User-Domain-Id: default Jun 06 10:44:13.365355 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-User-Domain-Name: Default Jun 06 10:44:13.365355 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-User-Id: f6b7d82c999646b6b6b96d565f0e3f9a Jun 06 10:44:13.365355 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-User-Name: tempest-AttachVolumeTestJSON-489641414-project Jun 06 10:44:13.365355 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: method: > Jun 06 10:44:13.365355 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: exception: Instance f49079c1-1384-4136-b6cf-eadc40fb5aa1 could not be found. Jun 06 10:44:13.365355 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: action_args: {'id': 'f49079c1-1384-4136-b6cf-eadc40fb5aa1'} Jun 06 10:44:13.366303 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 10:44:13.366303 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 10:44:13.366303 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 06 10:44:13.366303 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 06 10:44:13.366303 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 06 10:44:13.366303 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 06 10:44:13.366303 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 06 10:44:13.366303 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 06 10:44:13.366303 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 06 10:44:13.366303 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 06 10:44:13.366303 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f49079c1-1384-4136-b6cf-eadc40fb5aa1 could not be found. Jun 06 10:44:13.366303 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi Jun 06 10:44:13.366303 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 10:44:13.366303 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi Jun 06 10:44:13.366303 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 10:44:13.366303 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 10:44:13.366303 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 10:44:13.366303 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 10:44:13.366303 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 10:44:13.366303 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 10:44:13.367850 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 10:44:13.367850 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 06 10:44:13.367850 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 06 10:44:13.367850 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 06 10:44:13.367850 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 06 10:44:13.367850 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 06 10:44:13.367850 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 06 10:44:13.367850 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f49079c1-1384-4136-b6cf-eadc40fb5aa1 could not be found. Jun 06 10:44:13.367850 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi Jun 06 10:44:13.367850 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 10:44:13.367850 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi Jun 06 10:44:13.367850 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 10:44:13.367850 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 10:44:13.367850 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 10:44:13.367850 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 10:44:13.367850 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 10:44:13.367850 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f49079c1-1384-4136-b6cf-eadc40fb5aa1 could not be found. Jun 06 10:44:13.367850 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi Jun 06 10:44:13.369377 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-b1a3e348-f906-46af-9dbe-400b558d4967 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] Returning 404 to user: Instance f49079c1-1384-4136-b6cf-eadc40fb5aa1 could not be found. {{(pid=129350) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 10:44:13.369377 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-b1a3e348-f906-46af-9dbe-400b558d4967 tempest-AttachVolumeTestJSON-489641414 tempest-AttachVolumeTestJSON-489641414-project] 10.222.0.42 "GET /compute/v2.1/servers/f49079c1-1384-4136-b6cf-eadc40fb5aa1" status: 404 len: 111 microversion: 2.1 time: 0.029477 Jun 06 10:44:13.369377 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 342/700] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:44:13 2022] GET /compute/v2.1/servers/f49079c1-1384-4136-b6cf-eadc40fb5aa1 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 06 10:44:13.593950 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-8ec7dbe8-ac35-4bfe-abd5-5894bcd3fcbe tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:44:13.594961 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-8ec7dbe8-ac35-4bfe-abd5-5894bcd3fcbe tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] [instance: ce3b66f8-03e9-4d5f-8c40-d1a887b12304] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:44:13.600594 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-8ec7dbe8-ac35-4bfe-abd5-5894bcd3fcbe tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:44:13.601040 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-8ec7dbe8-ac35-4bfe-abd5-5894bcd3fcbe tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:44:13.601815 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-8ec7dbe8-ac35-4bfe-abd5-5894bcd3fcbe tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:44:13.602259 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-8ec7dbe8-ac35-4bfe-abd5-5894bcd3fcbe tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:44:13.831141 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-8ec7dbe8-ac35-4bfe-abd5-5894bcd3fcbe tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:44:13.839336 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-8ec7dbe8-ac35-4bfe-abd5-5894bcd3fcbe tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:44:13.841010 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-8ec7dbe8-ac35-4bfe-abd5-5894bcd3fcbe tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:44:13.842170 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-8ec7dbe8-ac35-4bfe-abd5-5894bcd3fcbe tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] 10.222.0.42 "GET /compute/v2.1/servers/ce3b66f8-03e9-4d5f-8c40-d1a887b12304" status: 200 len: 1722 microversion: 2.20 time: 0.253206 Jun 06 10:44:13.842730 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 359/701] 10.222.0.42 () {60 vars in 1276 bytes} [Mon Jun 6 10:44:13 2022] GET /compute/v2.1/servers/ce3b66f8-03e9-4d5f-8c40-d1a887b12304 => generated 1722 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 10:44:13.860985 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-157648f2-6411-4feb-8eab-a5722e9a2d4f tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "dda3f7ae-1ca3-4b17-84bc-c9627f98e3dd"}} {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 10:44:13.862031 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-157648f2-6411-4feb-8eab-a5722e9a2d4f tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] [instance: ce3b66f8-03e9-4d5f-8c40-d1a887b12304] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:44:13.867945 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-157648f2-6411-4feb-8eab-a5722e9a2d4f tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:44:13.868395 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-157648f2-6411-4feb-8eab-a5722e9a2d4f tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:44:13.869181 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-157648f2-6411-4feb-8eab-a5722e9a2d4f tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:44:13.869606 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-157648f2-6411-4feb-8eab-a5722e9a2d4f tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:44:14.165769 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-157648f2-6411-4feb-8eab-a5722e9a2d4f tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] 10.222.0.42 "POST /compute/v2.1/servers/ce3b66f8-03e9-4d5f-8c40-d1a887b12304/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.308708 Jun 06 10:44:14.166421 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 343/702] 10.222.0.42 () {62 vars in 1363 bytes} [Mon Jun 6 10:44:13 2022] POST /compute/v2.1/servers/ce3b66f8-03e9-4d5f-8c40-d1a887b12304/os-volume_attachments => generated 188 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 06 10:44:14.278979 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-55274ef4-1b96-414f-8c48-6fa61a5700f6 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:44:14.279091 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-55274ef4-1b96-414f-8c48-6fa61a5700f6 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] [instance: ce3b66f8-03e9-4d5f-8c40-d1a887b12304] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:44:14.285111 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-55274ef4-1b96-414f-8c48-6fa61a5700f6 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:44:14.285555 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-55274ef4-1b96-414f-8c48-6fa61a5700f6 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:44:14.286325 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-55274ef4-1b96-414f-8c48-6fa61a5700f6 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:44:14.286753 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-55274ef4-1b96-414f-8c48-6fa61a5700f6 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:44:14.407709 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [req-206dc903-870d-4ca6-bbb7-a3235c1a4c1c req-0466df5b-3e5d-4082-b8aa-085f9658c2a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce3b66f8-03e9-4d5f-8c40-d1a887b12304", "name": "network-vif-unplugged", "status": "completed", "tag": "ff3196f2-cd2c-4cef-8ac8-2d796e5a93a2"}]} {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 10:44:14.422760 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [req-206dc903-870d-4ca6-bbb7-a3235c1a4c1c req-0466df5b-3e5d-4082-b8aa-085f9658c2a8 service nova] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:44:14.423470 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [req-206dc903-870d-4ca6-bbb7-a3235c1a4c1c req-0466df5b-3e5d-4082-b8aa-085f9658c2a8 service nova] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:44:14.436264 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.compute.server_external_events [req-206dc903-870d-4ca6-bbb7-a3235c1a4c1c req-0466df5b-3e5d-4082-b8aa-085f9658c2a8 service nova] Unable to find a host for instance ce3b66f8-03e9-4d5f-8c40-d1a887b12304. Dropping event network-vif-unplugged {{(pid=129350) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jun 06 10:44:14.437675 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [req-206dc903-870d-4ca6-bbb7-a3235c1a4c1c req-0466df5b-3e5d-4082-b8aa-085f9658c2a8 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.035031 Jun 06 10:44:14.438524 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 344/703] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Jun 6 10:44:14 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 37 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Jun 06 10:44:14.519796 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG dbcounter [-] [129349] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=4,nova_cell1:UPDATE=2 {{(pid=129349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 10:44:14.546010 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-55274ef4-1b96-414f-8c48-6fa61a5700f6 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] 10.222.0.42 "DELETE /compute/v2.1/servers/ce3b66f8-03e9-4d5f-8c40-d1a887b12304/os-volume_attachments/dda3f7ae-1ca3-4b17-84bc-c9627f98e3dd" status: 202 len: 0 microversion: 2.20 time: 0.272837 Jun 06 10:44:14.548918 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 360/704] 10.222.0.42 () {60 vars in 1456 bytes} [Mon Jun 6 10:44:14 2022] DELETE /compute/v2.1/servers/ce3b66f8-03e9-4d5f-8c40-d1a887b12304/os-volume_attachments/dda3f7ae-1ca3-4b17-84bc-c9627f98e3dd => generated 0 bytes in 276 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 06 10:44:14.607537 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-2229f537-f7ad-42af-8a50-ec1ae47f767d tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 10:44:14.608594 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-2229f537-f7ad-42af-8a50-ec1ae47f767d tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] [instance: ce3b66f8-03e9-4d5f-8c40-d1a887b12304] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:44:14.615888 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-2229f537-f7ad-42af-8a50-ec1ae47f767d tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:44:14.616595 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-2229f537-f7ad-42af-8a50-ec1ae47f767d tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:44:14.617373 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-2229f537-f7ad-42af-8a50-ec1ae47f767d tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:44:14.617803 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-2229f537-f7ad-42af-8a50-ec1ae47f767d tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:44:14.707394 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-2229f537-f7ad-42af-8a50-ec1ae47f767d tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] 10.222.0.42 "POST /compute/v2.1/servers/ce3b66f8-03e9-4d5f-8c40-d1a887b12304/action" status: 202 len: 0 microversion: 2.20 time: 0.104402 Jun 06 10:44:14.711194 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 345/705] 10.222.0.42 () {62 vars in 1318 bytes} [Mon Jun 6 10:44:14 2022] POST /compute/v2.1/servers/ce3b66f8-03e9-4d5f-8c40-d1a887b12304/action => generated 0 bytes in 106 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jun 06 10:44:14.716608 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-d5da2021-4290-4b2b-a8c9-39af467acd15 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:44:14.717332 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-d5da2021-4290-4b2b-a8c9-39af467acd15 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] [instance: ce3b66f8-03e9-4d5f-8c40-d1a887b12304] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:44:14.723722 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-d5da2021-4290-4b2b-a8c9-39af467acd15 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:44:14.724215 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-d5da2021-4290-4b2b-a8c9-39af467acd15 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:44:14.725005 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-d5da2021-4290-4b2b-a8c9-39af467acd15 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:44:14.725485 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-d5da2021-4290-4b2b-a8c9-39af467acd15 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:44:15.165244 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-d5da2021-4290-4b2b-a8c9-39af467acd15 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:44:15.174157 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-d5da2021-4290-4b2b-a8c9-39af467acd15 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:44:15.175672 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-d5da2021-4290-4b2b-a8c9-39af467acd15 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:44:15.176862 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-d5da2021-4290-4b2b-a8c9-39af467acd15 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] 10.222.0.42 "GET /compute/v2.1/servers/ce3b66f8-03e9-4d5f-8c40-d1a887b12304" status: 200 len: 1670 microversion: 2.20 time: 0.464503 Jun 06 10:44:15.177604 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 361/706] 10.222.0.42 () {60 vars in 1276 bytes} [Mon Jun 6 10:44:14 2022] GET /compute/v2.1/servers/ce3b66f8-03e9-4d5f-8c40-d1a887b12304 => generated 1670 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 06 10:44:16.195043 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-d2496d6a-813c-4378-aded-f447d3c2e0bf tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:44:16.195681 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-d2496d6a-813c-4378-aded-f447d3c2e0bf tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] [instance: ce3b66f8-03e9-4d5f-8c40-d1a887b12304] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:44:16.201926 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-d2496d6a-813c-4378-aded-f447d3c2e0bf tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:44:16.202416 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-d2496d6a-813c-4378-aded-f447d3c2e0bf tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:44:16.203193 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-d2496d6a-813c-4378-aded-f447d3c2e0bf tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:44:16.203632 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-d2496d6a-813c-4378-aded-f447d3c2e0bf tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:44:16.207652 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG dbcounter [-] [129350] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=6,nova_cell1:INSERT=5 {{(pid=129350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 10:44:16.483383 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-d2496d6a-813c-4378-aded-f447d3c2e0bf tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:44:16.492009 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-d2496d6a-813c-4378-aded-f447d3c2e0bf tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:44:16.493533 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-d2496d6a-813c-4378-aded-f447d3c2e0bf tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:44:16.494776 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-d2496d6a-813c-4378-aded-f447d3c2e0bf tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] 10.222.0.42 "GET /compute/v2.1/servers/ce3b66f8-03e9-4d5f-8c40-d1a887b12304" status: 200 len: 1728 microversion: 2.20 time: 0.304172 Jun 06 10:44:16.496384 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 346/707] 10.222.0.42 () {60 vars in 1276 bytes} [Mon Jun 6 10:44:16 2022] GET /compute/v2.1/servers/ce3b66f8-03e9-4d5f-8c40-d1a887b12304 => generated 1728 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 10:44:17.515907 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-c60ab59e-fb6e-4ad2-a48e-36df36fa117e tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:44:17.517162 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-c60ab59e-fb6e-4ad2-a48e-36df36fa117e tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] [instance: ce3b66f8-03e9-4d5f-8c40-d1a887b12304] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:44:17.531109 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-c60ab59e-fb6e-4ad2-a48e-36df36fa117e tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:44:17.533509 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-c60ab59e-fb6e-4ad2-a48e-36df36fa117e tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:44:17.535203 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-c60ab59e-fb6e-4ad2-a48e-36df36fa117e tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:44:17.537059 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-c60ab59e-fb6e-4ad2-a48e-36df36fa117e tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:44:17.829315 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-c60ab59e-fb6e-4ad2-a48e-36df36fa117e tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:44:17.838751 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-c60ab59e-fb6e-4ad2-a48e-36df36fa117e tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:44:17.841255 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-c60ab59e-fb6e-4ad2-a48e-36df36fa117e tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:44:17.842699 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-c60ab59e-fb6e-4ad2-a48e-36df36fa117e tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] 10.222.0.42 "GET /compute/v2.1/servers/ce3b66f8-03e9-4d5f-8c40-d1a887b12304" status: 200 len: 1728 microversion: 2.20 time: 0.332491 Jun 06 10:44:17.843329 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 362/708] 10.222.0.42 () {60 vars in 1276 bytes} [Mon Jun 6 10:44:17 2022] GET /compute/v2.1/servers/ce3b66f8-03e9-4d5f-8c40-d1a887b12304 => generated 1728 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 10:44:18.834225 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-fa5aef78-6cdc-4034-b7a5-cac902866eba tempest-VolumesGetTestJSON-494334771 tempest-VolumesGetTestJSON-494334771-project] Action: 'create', calling method: .version_select at 0x7f8fd828d1f0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-2014451562", "metadata": {"Type": "work"}}} {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 10:44:18.861630 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-7c28d68b-3b17-4947-9983-c0ee8570db8f tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:44:18.862247 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-7c28d68b-3b17-4947-9983-c0ee8570db8f tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] [instance: ce3b66f8-03e9-4d5f-8c40-d1a887b12304] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:44:18.869108 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-7c28d68b-3b17-4947-9983-c0ee8570db8f tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:44:18.869579 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-7c28d68b-3b17-4947-9983-c0ee8570db8f tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:44:18.870346 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-7c28d68b-3b17-4947-9983-c0ee8570db8f tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:44:18.871001 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-7c28d68b-3b17-4947-9983-c0ee8570db8f tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:44:19.045966 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-7c28d68b-3b17-4947-9983-c0ee8570db8f tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:44:19.077485 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-7c28d68b-3b17-4947-9983-c0ee8570db8f tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:44:19.083207 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-7c28d68b-3b17-4947-9983-c0ee8570db8f tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:44:19.084901 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-7c28d68b-3b17-4947-9983-c0ee8570db8f tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] 10.222.0.42 "GET /compute/v2.1/servers/ce3b66f8-03e9-4d5f-8c40-d1a887b12304" status: 200 len: 1728 microversion: 2.20 time: 0.226774 Jun 06 10:44:19.086191 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 363/709] 10.222.0.42 () {60 vars in 1276 bytes} [Mon Jun 6 10:44:18 2022] GET /compute/v2.1/servers/ce3b66f8-03e9-4d5f-8c40-d1a887b12304 => generated 1728 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 06 10:44:19.274378 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-fa5aef78-6cdc-4034-b7a5-cac902866eba tempest-VolumesGetTestJSON-494334771 tempest-VolumesGetTestJSON-494334771-project] 10.222.0.42 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 0.582991 Jun 06 10:44:19.275153 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 347/710] 10.222.0.42 () {60 vars in 1155 bytes} [Mon Jun 6 10:44:18 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 584 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jun 06 10:44:19.290293 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-48e35c3c-ea53-4fed-89b8-4745f328c388 tempest-VolumesGetTestJSON-494334771 tempest-VolumesGetTestJSON-494334771-project] Calling method '.version_select at 0x7f8fd8271280>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:44:19.349162 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-48e35c3c-ea53-4fed-89b8-4745f328c388 tempest-VolumesGetTestJSON-494334771 tempest-VolumesGetTestJSON-494334771-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/7d6fa959-ff62-459a-9b73-a583d771f3bf" status: 200 len: 353 microversion: 2.1 time: 0.065075 Jun 06 10:44:19.349854 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 364/711] 10.222.0.42 () {58 vars in 1244 bytes} [Mon Jun 6 10:44:19 2022] GET /compute/v2.1/os-volumes/7d6fa959-ff62-459a-9b73-a583d771f3bf => generated 353 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 10:44:20.108846 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-5bb2244e-5366-4fef-a040-bbcea90368d2 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:44:20.109758 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-5bb2244e-5366-4fef-a040-bbcea90368d2 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] [instance: ce3b66f8-03e9-4d5f-8c40-d1a887b12304] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:44:20.123294 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-5bb2244e-5366-4fef-a040-bbcea90368d2 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:44:20.123944 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-5bb2244e-5366-4fef-a040-bbcea90368d2 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:44:20.125047 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-5bb2244e-5366-4fef-a040-bbcea90368d2 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:44:20.125659 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-5bb2244e-5366-4fef-a040-bbcea90368d2 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:44:20.289484 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-5bb2244e-5366-4fef-a040-bbcea90368d2 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:44:20.298940 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-5bb2244e-5366-4fef-a040-bbcea90368d2 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:44:20.300501 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-5bb2244e-5366-4fef-a040-bbcea90368d2 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:44:20.301694 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-5bb2244e-5366-4fef-a040-bbcea90368d2 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] 10.222.0.42 "GET /compute/v2.1/servers/ce3b66f8-03e9-4d5f-8c40-d1a887b12304" status: 200 len: 1728 microversion: 2.20 time: 0.199365 Jun 06 10:44:20.302246 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 348/712] 10.222.0.42 () {60 vars in 1276 bytes} [Mon Jun 6 10:44:20 2022] GET /compute/v2.1/servers/ce3b66f8-03e9-4d5f-8c40-d1a887b12304 => generated 1728 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 10:44:20.362921 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-4b64d9be-a33f-467e-9f85-0744825d6ee2 tempest-VolumesGetTestJSON-494334771 tempest-VolumesGetTestJSON-494334771-project] Calling method '.version_select at 0x7f8fd8175ca0>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:44:20.412391 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-4b64d9be-a33f-467e-9f85-0744825d6ee2 tempest-VolumesGetTestJSON-494334771 tempest-VolumesGetTestJSON-494334771-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/7d6fa959-ff62-459a-9b73-a583d771f3bf" status: 200 len: 354 microversion: 2.1 time: 0.053834 Jun 06 10:44:20.413698 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 365/713] 10.222.0.42 () {58 vars in 1244 bytes} [Mon Jun 6 10:44:20 2022] GET /compute/v2.1/os-volumes/7d6fa959-ff62-459a-9b73-a583d771f3bf => generated 354 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 10:44:20.425075 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-2069709b-72f6-4ddc-b956-1ee40b530f87 tempest-VolumesGetTestJSON-494334771 tempest-VolumesGetTestJSON-494334771-project] Calling method '.version_select at 0x7f8fd80661f0>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:44:20.478904 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-2069709b-72f6-4ddc-b956-1ee40b530f87 tempest-VolumesGetTestJSON-494334771 tempest-VolumesGetTestJSON-494334771-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/7d6fa959-ff62-459a-9b73-a583d771f3bf" status: 200 len: 354 microversion: 2.1 time: 0.057266 Jun 06 10:44:20.479805 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 349/714] 10.222.0.42 () {58 vars in 1244 bytes} [Mon Jun 6 10:44:20 2022] GET /compute/v2.1/os-volumes/7d6fa959-ff62-459a-9b73-a583d771f3bf => generated 354 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 10:44:20.503096 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-48dbdc68-04df-44c7-a4e0-ee502bf46ded tempest-VolumesGetTestJSON-494334771 tempest-VolumesGetTestJSON-494334771-project] Calling method '.version_select at 0x7f8fd8175dc0>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:44:20.568255 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-48dbdc68-04df-44c7-a4e0-ee502bf46ded tempest-VolumesGetTestJSON-494334771 tempest-VolumesGetTestJSON-494334771-project] 10.222.0.42 "DELETE /compute/v2.1/os-volumes/7d6fa959-ff62-459a-9b73-a583d771f3bf" status: 202 len: 0 microversion: 2.1 time: 0.069349 Jun 06 10:44:20.568822 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 366/715] 10.222.0.42 () {58 vars in 1247 bytes} [Mon Jun 6 10:44:20 2022] DELETE /compute/v2.1/os-volumes/7d6fa959-ff62-459a-9b73-a583d771f3bf => generated 0 bytes in 71 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 06 10:44:20.579629 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-fc236b7e-d498-4c8e-9085-bcbafa8c8a62 tempest-VolumesGetTestJSON-494334771 tempest-VolumesGetTestJSON-494334771-project] Calling method '.version_select at 0x7f8fd3792f70>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:44:20.638621 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-fc236b7e-d498-4c8e-9085-bcbafa8c8a62 tempest-VolumesGetTestJSON-494334771 tempest-VolumesGetTestJSON-494334771-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/7d6fa959-ff62-459a-9b73-a583d771f3bf" status: 200 len: 353 microversion: 2.1 time: 0.065203 Jun 06 10:44:20.639270 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 350/716] 10.222.0.42 () {58 vars in 1244 bytes} [Mon Jun 6 10:44:20 2022] GET /compute/v2.1/os-volumes/7d6fa959-ff62-459a-9b73-a583d771f3bf => generated 353 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 10:44:20.924197 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-0bc822c1-8b49-4b93-b5e7-e1235ac720c9 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:44:20.924777 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-0bc822c1-8b49-4b93-b5e7-e1235ac720c9 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] [instance: 3827eb37-6346-4a31-a6e5-25b90628827c] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:44:20.931132 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-0bc822c1-8b49-4b93-b5e7-e1235ac720c9 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:44:20.931676 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-0bc822c1-8b49-4b93-b5e7-e1235ac720c9 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:44:20.932554 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-0bc822c1-8b49-4b93-b5e7-e1235ac720c9 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:44:20.933124 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-0bc822c1-8b49-4b93-b5e7-e1235ac720c9 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:44:20.957291 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-0bc822c1-8b49-4b93-b5e7-e1235ac720c9 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] 10.222.0.42 "GET /compute/v2.1/servers/3827eb37-6346-4a31-a6e5-25b90628827c/ips" status: 200 len: 149 microversion: 2.1 time: 0.036915 Jun 06 10:44:20.957848 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 367/717] 10.222.0.42 () {58 vars in 1247 bytes} [Mon Jun 6 10:44:20 2022] GET /compute/v2.1/servers/3827eb37-6346-4a31-a6e5-25b90628827c/ips => generated 149 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 10:44:21.322728 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-51acbce4-d257-4bf7-94b3-06da1620f0ce tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:44:21.324455 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-51acbce4-d257-4bf7-94b3-06da1620f0ce tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] [instance: ce3b66f8-03e9-4d5f-8c40-d1a887b12304] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:44:21.335342 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-51acbce4-d257-4bf7-94b3-06da1620f0ce tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:44:21.336145 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-51acbce4-d257-4bf7-94b3-06da1620f0ce tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:44:21.337518 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-51acbce4-d257-4bf7-94b3-06da1620f0ce tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:44:21.338314 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-51acbce4-d257-4bf7-94b3-06da1620f0ce tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:44:21.506941 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-51acbce4-d257-4bf7-94b3-06da1620f0ce tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:44:21.523359 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-51acbce4-d257-4bf7-94b3-06da1620f0ce tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:44:21.526648 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-51acbce4-d257-4bf7-94b3-06da1620f0ce tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:44:21.529187 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-51acbce4-d257-4bf7-94b3-06da1620f0ce tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] 10.222.0.42 "GET /compute/v2.1/servers/ce3b66f8-03e9-4d5f-8c40-d1a887b12304" status: 200 len: 1728 microversion: 2.20 time: 0.211501 Jun 06 10:44:21.530228 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 351/718] 10.222.0.42 () {60 vars in 1276 bytes} [Mon Jun 6 10:44:21 2022] GET /compute/v2.1/servers/ce3b66f8-03e9-4d5f-8c40-d1a887b12304 => generated 1728 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 10:44:21.651446 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-bbd13928-5ab6-49b0-8b89-13107f9e007b tempest-VolumesGetTestJSON-494334771 tempest-VolumesGetTestJSON-494334771-project] Calling method '.version_select at 0x7f8fd3686dc0>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:44:21.682348 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.wsgi [None req-bbd13928-5ab6-49b0-8b89-13107f9e007b tempest-VolumesGetTestJSON-494334771 tempest-VolumesGetTestJSON-494334771-project] HTTP exception thrown: Volume 7d6fa959-ff62-459a-9b73-a583d771f3bf could not be found. Jun 06 10:44:21.686097 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-bbd13928-5ab6-49b0-8b89-13107f9e007b tempest-VolumesGetTestJSON-494334771 tempest-VolumesGetTestJSON-494334771-project] Request method failure captured: Jun 06 10:44:21.686097 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: request: GET /compute/v2.1/os-volumes/7d6fa959-ff62-459a-9b73-a583d771f3bf HTTP/1.1 Jun 06 10:44:21.686097 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: Accept: application/json Jun 06 10:44:21.686097 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: Accept-Encoding: identity Jun 06 10:44:21.686097 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: Connection: close Jun 06 10:44:21.686097 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: Content-Length: 0 Jun 06 10:44:21.686097 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: Content-Type: application/json Jun 06 10:44:21.686097 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: Host: 10.222.0.42 Jun 06 10:44:21.686097 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: Openstack-System-Scope: None Jun 06 10:44:21.686097 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: User-Agent: python-urllib3/1.26.9 Jun 06 10:44:21.686097 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Auth-Token: gAAAAABindqCtntwfO_MSCsqg6YBXzNUzczI0qF2nMbEhHtNjTy0YB4aLDIOjpxyD4O7fUIgVWaKwhCKlMHpLP4DMs9xsUh-G0nsWOwZGRk9F8sYrZlq4smzNyJWXjjcOfJ6x4LPWlRQRwTs7bd0JLuyokO5Su8JKAiovsI8RUjR2f91IefyhvU Jun 06 10:44:21.686097 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Domain-Id: None Jun 06 10:44:21.686097 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Domain-Name: None Jun 06 10:44:21.686097 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Identity-Status: Confirmed Jun 06 10:44:21.686097 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Is-Admin-Project: True Jun 06 10:44:21.686097 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Project-Domain-Id: default Jun 06 10:44:21.686097 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Project-Domain-Name: Default Jun 06 10:44:21.686097 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Project-Id: 67054e1e988a4691a3c8a8816c21de82 Jun 06 10:44:21.686097 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Project-Name: tempest-VolumesGetTestJSON-494334771 Jun 06 10:44:21.686097 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Role: member,reader Jun 06 10:44:21.686097 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Roles: member,reader Jun 06 10:44:21.688040 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/67054e1e988a4691a3c8a8816c21de82"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/67054e1e988a4691a3c8a8816c21de82"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/67054e1e988a4691a3c8a8816c21de82"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_67054e1e988a4691a3c8a8816c21de82", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Jun 06 10:44:21.688040 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Tenant: tempest-VolumesGetTestJSON-494334771 Jun 06 10:44:21.688040 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Tenant-Id: 67054e1e988a4691a3c8a8816c21de82 Jun 06 10:44:21.688040 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Tenant-Name: tempest-VolumesGetTestJSON-494334771 Jun 06 10:44:21.688040 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-User: tempest-VolumesGetTestJSON-494334771-project Jun 06 10:44:21.688040 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-User-Domain-Id: default Jun 06 10:44:21.688040 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-User-Domain-Name: Default Jun 06 10:44:21.688040 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-User-Id: 8972281e0c934d398104d8c78ebfdf71 Jun 06 10:44:21.688040 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-User-Name: tempest-VolumesGetTestJSON-494334771-project Jun 06 10:44:21.688040 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: method: Jun 06 10:44:21.688040 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: exception: Volume 7d6fa959-ff62-459a-9b73-a583d771f3bf could not be found. Jun 06 10:44:21.688040 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: action_args: {'id': '7d6fa959-ff62-459a-9b73-a583d771f3bf'} Jun 06 10:44:21.688040 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 10:44:21.689203 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 10:44:21.689203 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 06 10:44:21.689203 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 06 10:44:21.689203 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 06 10:44:21.689203 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 06 10:44:21.689203 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 06 10:44:21.689203 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 06 10:44:21.689203 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 06 10:44:21.689203 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 06 10:44:21.689203 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 06 10:44:21.689203 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 06 10:44:21.689203 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 06 10:44:21.689203 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 06 10:44:21.689203 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 06 10:44:21.689203 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 06 10:44:21.689203 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 7d6fa959-ff62-459a-9b73-a583d771f3bf could not be found. (HTTP 404) (Request-ID: req-5edf236f-3df7-407e-bd94-dc353ad2987f) Jun 06 10:44:21.689203 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Jun 06 10:44:21.689203 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 10:44:21.689203 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Jun 06 10:44:21.690997 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 10:44:21.690997 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 06 10:44:21.690997 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 06 10:44:21.690997 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 06 10:44:21.690997 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 06 10:44:21.690997 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 06 10:44:21.690997 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 06 10:44:21.690997 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 06 10:44:21.690997 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 06 10:44:21.690997 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 06 10:44:21.690997 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 06 10:44:21.690997 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 06 10:44:21.690997 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 06 10:44:21.690997 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 06 10:44:21.690997 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 06 10:44:21.690997 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 06 10:44:21.690997 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 06 10:44:21.690997 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 06 10:44:21.690997 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 06 10:44:21.693737 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 06 10:44:21.693737 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 06 10:44:21.693737 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 06 10:44:21.693737 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 06 10:44:21.693737 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 7d6fa959-ff62-459a-9b73-a583d771f3bf could not be found. Jun 06 10:44:21.693737 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Jun 06 10:44:21.693737 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 10:44:21.693737 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Jun 06 10:44:21.693737 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 10:44:21.693737 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 10:44:21.693737 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 10:44:21.693737 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 10:44:21.693737 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 10:44:21.693737 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 06 10:44:21.693737 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 06 10:44:21.693737 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 10:44:21.693737 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 10:44:21.693737 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 06 10:44:21.693737 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 06 10:44:21.695728 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 7d6fa959-ff62-459a-9b73-a583d771f3bf could not be found. Jun 06 10:44:21.695728 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Jun 06 10:44:21.695728 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 10:44:21.695728 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Jun 06 10:44:21.695728 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 10:44:21.695728 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 10:44:21.695728 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 10:44:21.695728 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 10:44:21.695728 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 10:44:21.695728 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 7d6fa959-ff62-459a-9b73-a583d771f3bf could not be found. Jun 06 10:44:21.695728 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Jun 06 10:44:21.696805 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-bbd13928-5ab6-49b0-8b89-13107f9e007b tempest-VolumesGetTestJSON-494334771 tempest-VolumesGetTestJSON-494334771-project] Returning 404 to user: Volume 7d6fa959-ff62-459a-9b73-a583d771f3bf could not be found. {{(pid=129349) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 10:44:21.697689 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-bbd13928-5ab6-49b0-8b89-13107f9e007b tempest-VolumesGetTestJSON-494334771 tempest-VolumesGetTestJSON-494334771-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/7d6fa959-ff62-459a-9b73-a583d771f3bf" status: 404 len: 109 microversion: 2.1 time: 0.050102 Jun 06 10:44:21.698261 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 368/719] 10.222.0.42 () {58 vars in 1244 bytes} [Mon Jun 6 10:44:21 2022] GET /compute/v2.1/os-volumes/7d6fa959-ff62-459a-9b73-a583d771f3bf => generated 109 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 06 10:44:22.394235 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-ba4ec0f5-758a-4e68-b5b4-ea985dae8c2a tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ce183db7-fc9b-4b15-a86a-e931704dc836"}} {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 10:44:22.395390 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-ba4ec0f5-758a-4e68-b5b4-ea985dae8c2a tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] [instance: 3827eb37-6346-4a31-a6e5-25b90628827c] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:44:22.403732 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-ba4ec0f5-758a-4e68-b5b4-ea985dae8c2a tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:44:22.404524 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-ba4ec0f5-758a-4e68-b5b4-ea985dae8c2a tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:44:22.405608 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-ba4ec0f5-758a-4e68-b5b4-ea985dae8c2a tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:44:22.406207 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-ba4ec0f5-758a-4e68-b5b4-ea985dae8c2a tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:44:22.551901 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-a639ecf6-1cfc-47b1-9e1f-2dfab2bdf750 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:44:22.552513 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-a639ecf6-1cfc-47b1-9e1f-2dfab2bdf750 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] [instance: ce3b66f8-03e9-4d5f-8c40-d1a887b12304] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:44:22.560490 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-a639ecf6-1cfc-47b1-9e1f-2dfab2bdf750 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:44:22.561232 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-a639ecf6-1cfc-47b1-9e1f-2dfab2bdf750 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:44:22.562418 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-a639ecf6-1cfc-47b1-9e1f-2dfab2bdf750 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:44:22.563093 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-a639ecf6-1cfc-47b1-9e1f-2dfab2bdf750 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:44:22.735860 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-a639ecf6-1cfc-47b1-9e1f-2dfab2bdf750 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:44:22.752078 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-a639ecf6-1cfc-47b1-9e1f-2dfab2bdf750 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:44:22.758508 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-a639ecf6-1cfc-47b1-9e1f-2dfab2bdf750 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:44:22.762415 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-a639ecf6-1cfc-47b1-9e1f-2dfab2bdf750 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] 10.222.0.42 "GET /compute/v2.1/servers/ce3b66f8-03e9-4d5f-8c40-d1a887b12304" status: 200 len: 1728 microversion: 2.20 time: 0.213316 Jun 06 10:44:22.765510 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 369/720] 10.222.0.42 () {60 vars in 1276 bytes} [Mon Jun 6 10:44:22 2022] GET /compute/v2.1/servers/ce3b66f8-03e9-4d5f-8c40-d1a887b12304 => generated 1728 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 10:44:23.790851 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-816b6721-d875-45c7-904f-aa28b2661acc tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:44:23.792404 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-816b6721-d875-45c7-904f-aa28b2661acc tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] [instance: ce3b66f8-03e9-4d5f-8c40-d1a887b12304] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:44:23.803251 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-816b6721-d875-45c7-904f-aa28b2661acc tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:44:23.804051 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-816b6721-d875-45c7-904f-aa28b2661acc tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:44:23.805695 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-816b6721-d875-45c7-904f-aa28b2661acc tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:44:23.806287 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-816b6721-d875-45c7-904f-aa28b2661acc tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:44:23.992017 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-816b6721-d875-45c7-904f-aa28b2661acc tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:44:24.001373 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-816b6721-d875-45c7-904f-aa28b2661acc tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:44:24.004603 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-816b6721-d875-45c7-904f-aa28b2661acc tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:44:24.005932 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-816b6721-d875-45c7-904f-aa28b2661acc tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] 10.222.0.42 "GET /compute/v2.1/servers/ce3b66f8-03e9-4d5f-8c40-d1a887b12304" status: 200 len: 1728 microversion: 2.20 time: 0.226270 Jun 06 10:44:24.006498 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 370/721] 10.222.0.42 () {60 vars in 1276 bytes} [Mon Jun 6 10:44:23 2022] GET /compute/v2.1/servers/ce3b66f8-03e9-4d5f-8c40-d1a887b12304 => generated 1728 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 06 10:44:25.024467 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-647bb3bd-1f6d-49cd-85d6-9e75bfee8855 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:44:25.025175 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-647bb3bd-1f6d-49cd-85d6-9e75bfee8855 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] [instance: ce3b66f8-03e9-4d5f-8c40-d1a887b12304] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:44:25.032229 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-647bb3bd-1f6d-49cd-85d6-9e75bfee8855 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:44:25.032925 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-647bb3bd-1f6d-49cd-85d6-9e75bfee8855 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:44:25.033872 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-647bb3bd-1f6d-49cd-85d6-9e75bfee8855 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:44:25.034461 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-647bb3bd-1f6d-49cd-85d6-9e75bfee8855 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:44:25.180547 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-647bb3bd-1f6d-49cd-85d6-9e75bfee8855 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:44:25.189663 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-647bb3bd-1f6d-49cd-85d6-9e75bfee8855 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:44:25.191162 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-647bb3bd-1f6d-49cd-85d6-9e75bfee8855 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:44:25.192372 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-647bb3bd-1f6d-49cd-85d6-9e75bfee8855 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] 10.222.0.42 "GET /compute/v2.1/servers/ce3b66f8-03e9-4d5f-8c40-d1a887b12304" status: 200 len: 1728 microversion: 2.20 time: 0.171832 Jun 06 10:44:25.193097 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 371/722] 10.222.0.42 () {60 vars in 1276 bytes} [Mon Jun 6 10:44:25 2022] GET /compute/v2.1/servers/ce3b66f8-03e9-4d5f-8c40-d1a887b12304 => generated 1728 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 06 10:44:26.211204 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-efda50f1-ee2e-4931-886c-c6040345874d tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:44:26.211888 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-efda50f1-ee2e-4931-886c-c6040345874d tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] [instance: ce3b66f8-03e9-4d5f-8c40-d1a887b12304] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:44:26.218375 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-efda50f1-ee2e-4931-886c-c6040345874d tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:44:26.218830 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-efda50f1-ee2e-4931-886c-c6040345874d tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:44:26.219591 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-efda50f1-ee2e-4931-886c-c6040345874d tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:44:26.220055 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-efda50f1-ee2e-4931-886c-c6040345874d tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:44:26.353394 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-efda50f1-ee2e-4931-886c-c6040345874d tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:44:26.364019 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-efda50f1-ee2e-4931-886c-c6040345874d tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:44:26.365574 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-efda50f1-ee2e-4931-886c-c6040345874d tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:44:26.366735 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-efda50f1-ee2e-4931-886c-c6040345874d tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] 10.222.0.42 "GET /compute/v2.1/servers/ce3b66f8-03e9-4d5f-8c40-d1a887b12304" status: 200 len: 1728 microversion: 2.20 time: 0.159486 Jun 06 10:44:26.367290 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 372/723] 10.222.0.42 () {60 vars in 1276 bytes} [Mon Jun 6 10:44:26 2022] GET /compute/v2.1/servers/ce3b66f8-03e9-4d5f-8c40-d1a887b12304 => generated 1728 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 06 10:44:26.704687 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-ba4ec0f5-758a-4e68-b5b4-ea985dae8c2a tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] 10.222.0.42 "POST /compute/v2.1/servers/3827eb37-6346-4a31-a6e5-25b90628827c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 4.315632 Jun 06 10:44:26.705736 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 352/724] 10.222.0.42 () {60 vars in 1322 bytes} [Mon Jun 6 10:44:22 2022] POST /compute/v2.1/servers/3827eb37-6346-4a31-a6e5-25b90628827c/os-volume_attachments => generated 194 bytes in 4318 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 10:44:27.387194 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-9a3918ef-776f-4d26-ad39-cb7ec94bdaee tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:44:27.390582 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-9a3918ef-776f-4d26-ad39-cb7ec94bdaee tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] [instance: ce3b66f8-03e9-4d5f-8c40-d1a887b12304] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:44:27.397093 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-9a3918ef-776f-4d26-ad39-cb7ec94bdaee tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:44:27.397544 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-9a3918ef-776f-4d26-ad39-cb7ec94bdaee tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:44:27.398330 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-9a3918ef-776f-4d26-ad39-cb7ec94bdaee tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:44:27.398759 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-9a3918ef-776f-4d26-ad39-cb7ec94bdaee tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:44:27.532864 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-9a3918ef-776f-4d26-ad39-cb7ec94bdaee tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:44:27.540652 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-9a3918ef-776f-4d26-ad39-cb7ec94bdaee tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:44:27.542707 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-9a3918ef-776f-4d26-ad39-cb7ec94bdaee tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:44:27.543982 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-9a3918ef-776f-4d26-ad39-cb7ec94bdaee tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] 10.222.0.42 "GET /compute/v2.1/servers/ce3b66f8-03e9-4d5f-8c40-d1a887b12304" status: 200 len: 1728 microversion: 2.20 time: 0.163034 Jun 06 10:44:27.544532 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 373/725] 10.222.0.42 () {60 vars in 1276 bytes} [Mon Jun 6 10:44:27 2022] GET /compute/v2.1/servers/ce3b66f8-03e9-4d5f-8c40-d1a887b12304 => generated 1728 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 06 10:44:28.565105 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-ec604590-dd09-48d7-9bb4-2bdc38b2b809 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:44:28.565912 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-ec604590-dd09-48d7-9bb4-2bdc38b2b809 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] [instance: ce3b66f8-03e9-4d5f-8c40-d1a887b12304] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:44:28.572188 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-ec604590-dd09-48d7-9bb4-2bdc38b2b809 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:44:28.572628 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-ec604590-dd09-48d7-9bb4-2bdc38b2b809 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:44:28.574020 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-ec604590-dd09-48d7-9bb4-2bdc38b2b809 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:44:28.574465 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-ec604590-dd09-48d7-9bb4-2bdc38b2b809 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:44:28.704307 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-ec604590-dd09-48d7-9bb4-2bdc38b2b809 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:44:28.712195 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-ec604590-dd09-48d7-9bb4-2bdc38b2b809 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:44:28.713725 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-ec604590-dd09-48d7-9bb4-2bdc38b2b809 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:44:28.714997 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-ec604590-dd09-48d7-9bb4-2bdc38b2b809 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] 10.222.0.42 "GET /compute/v2.1/servers/ce3b66f8-03e9-4d5f-8c40-d1a887b12304" status: 200 len: 1728 microversion: 2.20 time: 0.155798 Jun 06 10:44:28.715555 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 353/726] 10.222.0.42 () {60 vars in 1276 bytes} [Mon Jun 6 10:44:28 2022] GET /compute/v2.1/servers/ce3b66f8-03e9-4d5f-8c40-d1a887b12304 => generated 1728 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 10:44:29.733513 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-48c31f0e-74e9-43c3-936c-e87ab217f3ad tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:44:29.734099 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-48c31f0e-74e9-43c3-936c-e87ab217f3ad tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] [instance: ce3b66f8-03e9-4d5f-8c40-d1a887b12304] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:44:29.740549 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-48c31f0e-74e9-43c3-936c-e87ab217f3ad tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:44:29.740990 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-48c31f0e-74e9-43c3-936c-e87ab217f3ad tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:44:29.741766 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-48c31f0e-74e9-43c3-936c-e87ab217f3ad tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:44:29.742192 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-48c31f0e-74e9-43c3-936c-e87ab217f3ad tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:44:29.872153 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-48c31f0e-74e9-43c3-936c-e87ab217f3ad tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:44:29.881788 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-48c31f0e-74e9-43c3-936c-e87ab217f3ad tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:44:29.883388 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-48c31f0e-74e9-43c3-936c-e87ab217f3ad tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:44:29.884669 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-48c31f0e-74e9-43c3-936c-e87ab217f3ad tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] 10.222.0.42 "GET /compute/v2.1/servers/ce3b66f8-03e9-4d5f-8c40-d1a887b12304" status: 200 len: 1728 microversion: 2.20 time: 0.155258 Jun 06 10:44:29.886050 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 374/727] 10.222.0.42 () {60 vars in 1276 bytes} [Mon Jun 6 10:44:29 2022] GET /compute/v2.1/servers/ce3b66f8-03e9-4d5f-8c40-d1a887b12304 => generated 1728 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 10:44:30.904123 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-a61d871d-142f-48f2-9363-168e842063d6 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:44:30.904743 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-a61d871d-142f-48f2-9363-168e842063d6 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] [instance: ce3b66f8-03e9-4d5f-8c40-d1a887b12304] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:44:30.911448 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-a61d871d-142f-48f2-9363-168e842063d6 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:44:30.911997 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-a61d871d-142f-48f2-9363-168e842063d6 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:44:30.912779 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-a61d871d-142f-48f2-9363-168e842063d6 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:44:30.913217 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-a61d871d-142f-48f2-9363-168e842063d6 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:44:31.052387 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-a61d871d-142f-48f2-9363-168e842063d6 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:44:31.060699 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-a61d871d-142f-48f2-9363-168e842063d6 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:44:31.062284 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-a61d871d-142f-48f2-9363-168e842063d6 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:44:31.063422 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-a61d871d-142f-48f2-9363-168e842063d6 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] 10.222.0.42 "GET /compute/v2.1/servers/ce3b66f8-03e9-4d5f-8c40-d1a887b12304" status: 200 len: 1728 microversion: 2.20 time: 0.163887 Jun 06 10:44:31.064014 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 354/728] 10.222.0.42 () {60 vars in 1276 bytes} [Mon Jun 6 10:44:30 2022] GET /compute/v2.1/servers/ce3b66f8-03e9-4d5f-8c40-d1a887b12304 => generated 1728 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 10:44:32.081348 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-df0faffd-d782-4641-8f25-546668231a70 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:44:32.082008 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-df0faffd-d782-4641-8f25-546668231a70 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] [instance: ce3b66f8-03e9-4d5f-8c40-d1a887b12304] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:44:32.088849 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-df0faffd-d782-4641-8f25-546668231a70 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:44:32.089294 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-df0faffd-d782-4641-8f25-546668231a70 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:44:32.090201 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-df0faffd-d782-4641-8f25-546668231a70 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:44:32.090646 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-df0faffd-d782-4641-8f25-546668231a70 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:44:32.225129 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-df0faffd-d782-4641-8f25-546668231a70 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:44:32.233546 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-df0faffd-d782-4641-8f25-546668231a70 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:44:32.235142 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-df0faffd-d782-4641-8f25-546668231a70 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:44:32.236354 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-df0faffd-d782-4641-8f25-546668231a70 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] 10.222.0.42 "GET /compute/v2.1/servers/ce3b66f8-03e9-4d5f-8c40-d1a887b12304" status: 200 len: 1728 microversion: 2.20 time: 0.158932 Jun 06 10:44:32.236907 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 375/729] 10.222.0.42 () {60 vars in 1276 bytes} [Mon Jun 6 10:44:32 2022] GET /compute/v2.1/servers/ce3b66f8-03e9-4d5f-8c40-d1a887b12304 => generated 1728 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 10:44:32.492637 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [req-46bf020d-61c0-43d8-b559-6fca8c2a1968 req-f9a74d4f-7070-4f22-b6b7-b4aad7748706 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce3b66f8-03e9-4d5f-8c40-d1a887b12304", "name": "network-vif-plugged", "status": "completed", "tag": "ff3196f2-cd2c-4cef-8ac8-2d796e5a93a2"}]} {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 10:44:32.508753 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [req-46bf020d-61c0-43d8-b559-6fca8c2a1968 req-f9a74d4f-7070-4f22-b6b7-b4aad7748706 service nova] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:44:32.510337 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [req-46bf020d-61c0-43d8-b559-6fca8c2a1968 req-f9a74d4f-7070-4f22-b6b7-b4aad7748706 service nova] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:44:32.530230 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.compute.server_external_events [req-46bf020d-61c0-43d8-b559-6fca8c2a1968 req-f9a74d4f-7070-4f22-b6b7-b4aad7748706 service nova] Creating event network-vif-plugged:ff3196f2-cd2c-4cef-8ac8-2d796e5a93a2 for instance ce3b66f8-03e9-4d5f-8c40-d1a887b12304 on hv-cinder-84482 Jun 06 10:44:32.536769 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [req-46bf020d-61c0-43d8-b559-6fca8c2a1968 req-f9a74d4f-7070-4f22-b6b7-b4aad7748706 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048569 Jun 06 10:44:32.538710 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 355/730] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Jun 6 10:44:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 10:44:33.120904 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-2809df32-f741-45fd-bdaa-81cffd38a7a0 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Action: 'create', calling method: .version_select at 0x7f8fd81505e0>, body: {"keypair": {"name": "tempest-keypair-347975990", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM+bZAapANSKwTTx+BcZneYtZiqj8Jz9m9bc9ysLuo4OuaSyp+yVc5peOrUzK+RM/frXU1PjTSMiYzYtTBGCsgu8qkvC5ifY/NqgfwmrZdoELIKHCH0oLufF02+p39YUpA=="}} {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 10:44:33.135228 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.quota [None req-2809df32-f741-45fd-bdaa-81cffd38a7a0 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Getting quotas for project 92244b4ae17d49bebe621e803bd9ae58. Resources: {'key_pairs'} {{(pid=129349) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 06 10:44:33.140784 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.quota [None req-2809df32-f741-45fd-bdaa-81cffd38a7a0 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Getting quotas for user 7ba341ea1ac34874bbfb8b2f713aea1b and project 92244b4ae17d49bebe621e803bd9ae58. Resources: {'key_pairs'} {{(pid=129349) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 06 10:44:33.162502 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-2809df32-f741-45fd-bdaa-81cffd38a7a0 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.046099 Jun 06 10:44:33.163089 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 376/731] 10.222.0.42 () {60 vars in 1158 bytes} [Mon Jun 6 10:44:33 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 10:44:33.256158 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-886d23ee-34e7-41a1-bceb-b1330676c5d4 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:44:33.256853 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-886d23ee-34e7-41a1-bceb-b1330676c5d4 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] [instance: ce3b66f8-03e9-4d5f-8c40-d1a887b12304] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:44:33.264427 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-886d23ee-34e7-41a1-bceb-b1330676c5d4 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:44:33.265039 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-886d23ee-34e7-41a1-bceb-b1330676c5d4 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:44:33.265886 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-886d23ee-34e7-41a1-bceb-b1330676c5d4 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:44:33.266383 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-886d23ee-34e7-41a1-bceb-b1330676c5d4 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:44:33.413771 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-886d23ee-34e7-41a1-bceb-b1330676c5d4 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:44:33.439293 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-886d23ee-34e7-41a1-bceb-b1330676c5d4 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:44:33.449946 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-886d23ee-34e7-41a1-bceb-b1330676c5d4 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:44:33.451093 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-886d23ee-34e7-41a1-bceb-b1330676c5d4 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] 10.222.0.42 "GET /compute/v2.1/servers/ce3b66f8-03e9-4d5f-8c40-d1a887b12304" status: 200 len: 1728 microversion: 2.20 time: 0.199259 Jun 06 10:44:33.452044 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 356/732] 10.222.0.42 () {60 vars in 1276 bytes} [Mon Jun 6 10:44:33 2022] GET /compute/v2.1/servers/ce3b66f8-03e9-4d5f-8c40-d1a887b12304 => generated 1728 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 10:44:34.474084 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-6e21774a-3972-418b-820a-6733d769c25e tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:44:34.475030 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-6e21774a-3972-418b-820a-6733d769c25e tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] [instance: ce3b66f8-03e9-4d5f-8c40-d1a887b12304] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:44:34.486900 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-6e21774a-3972-418b-820a-6733d769c25e tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:44:34.487306 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-6e21774a-3972-418b-820a-6733d769c25e tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:44:34.488148 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-6e21774a-3972-418b-820a-6733d769c25e tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:44:34.488903 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-6e21774a-3972-418b-820a-6733d769c25e tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:44:34.668927 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-13c018b9-81d7-4212-b999-efa885890131 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-713862054", "imageRef": "6eea2d98-354d-4083-b74c-abcbb97f9e1a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3bc95a68-dc60-40e7-808c-a65a4ba0072c"}], "security_groups": [{"name": "tempest-securitygroup--58317742"}], "key_name": "tempest-keypair-347975990", "user_data": "}} {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 10:44:34.938539 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.network.neutron [None req-13c018b9-81d7-4212-b999-efa885890131 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] validate_networks() for [('3bc95a68-dc60-40e7-808c-a65a4ba0072c', None, None, None, None, None)] {{(pid=129350) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 06 10:44:35.039239 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-6e21774a-3972-418b-820a-6733d769c25e tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:44:35.048844 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-6e21774a-3972-418b-820a-6733d769c25e tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:44:35.050373 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-6e21774a-3972-418b-820a-6733d769c25e tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:44:35.051696 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-6e21774a-3972-418b-820a-6733d769c25e tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] 10.222.0.42 "GET /compute/v2.1/servers/ce3b66f8-03e9-4d5f-8c40-d1a887b12304" status: 200 len: 1728 microversion: 2.20 time: 0.585207 Jun 06 10:44:35.052809 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 377/733] 10.222.0.42 () {60 vars in 1276 bytes} [Mon Jun 6 10:44:34 2022] GET /compute/v2.1/servers/ce3b66f8-03e9-4d5f-8c40-d1a887b12304 => generated 1728 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 10:44:35.453603 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.virt.hardware [None req-13c018b9-81d7-4212-b999-efa885890131 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Flavor limits 0:0:0 {{(pid=129350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 06 10:44:35.454048 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.virt.hardware [None req-13c018b9-81d7-4212-b999-efa885890131 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Image limits 0:0:0 {{(pid=129350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 06 10:44:35.454516 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.virt.hardware [None req-13c018b9-81d7-4212-b999-efa885890131 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Flavor pref 0:0:0 {{(pid=129350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 06 10:44:35.454921 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.virt.hardware [None req-13c018b9-81d7-4212-b999-efa885890131 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Image pref 0:0:0 {{(pid=129350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 06 10:44:35.455327 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.virt.hardware [None req-13c018b9-81d7-4212-b999-efa885890131 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 06 10:44:35.465004 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-13c018b9-81d7-4212-b999-efa885890131 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:44:35.465453 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-13c018b9-81d7-4212-b999-efa885890131 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:44:35.466251 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-13c018b9-81d7-4212-b999-efa885890131 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:44:35.466683 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-13c018b9-81d7-4212-b999-efa885890131 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:44:35.487040 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.quota [None req-13c018b9-81d7-4212-b999-efa885890131 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Getting quotas for project 92244b4ae17d49bebe621e803bd9ae58. Resources: {'ram', 'cores', 'instances'} {{(pid=129350) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 06 10:44:35.491245 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.quota [None req-13c018b9-81d7-4212-b999-efa885890131 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Getting quotas for user 7ba341ea1ac34874bbfb8b2f713aea1b and project 92244b4ae17d49bebe621e803bd9ae58. Resources: {'ram', 'cores', 'instances'} {{(pid=129350) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 06 10:44:35.503134 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-13c018b9-81d7-4212-b999-efa885890131 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Going to run 1 instances... {{(pid=129350) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 06 10:44:35.505478 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-13c018b9-81d7-4212-b999-efa885890131 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] [instance: 7490171a-7d11-4bb4-ad17-852fdbd2af8b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6eea2d98-354d-4083-b74c-abcbb97f9e1a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129350) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 06 10:44:35.552326 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-13c018b9-81d7-4212-b999-efa885890131 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.888150 Jun 06 10:44:35.553095 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 357/734] 10.222.0.42 () {60 vars in 1146 bytes} [Mon Jun 6 10:44:34 2022] POST /compute/v2.1/servers => generated 400 bytes in 890 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 06 10:44:35.562989 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-705bb587-a0ed-4bff-a9cb-7f5e3dbc8f7b tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:44:35.563626 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-705bb587-a0ed-4bff-a9cb-7f5e3dbc8f7b tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] [instance: 7490171a-7d11-4bb4-ad17-852fdbd2af8b] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:44:35.631899 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-705bb587-a0ed-4bff-a9cb-7f5e3dbc8f7b tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ba341ea1ac34874bbfb8b2f713aea1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92244b4ae17d49bebe621e803bd9ae58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:44:35.631899 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-705bb587-a0ed-4bff-a9cb-7f5e3dbc8f7b tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] 10.222.0.42 "GET /compute/v2.1/servers/7490171a-7d11-4bb4-ad17-852fdbd2af8b" status: 200 len: 1240 microversion: 2.1 time: 0.071151 Jun 06 10:44:35.631899 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 378/735] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:44:35 2022] GET /compute/v2.1/servers/7490171a-7d11-4bb4-ad17-852fdbd2af8b => generated 1240 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:44:36.070785 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-17956936-e0b2-4883-8f44-c15c85d4c7ff tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:44:36.071415 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-17956936-e0b2-4883-8f44-c15c85d4c7ff tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] [instance: ce3b66f8-03e9-4d5f-8c40-d1a887b12304] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:44:36.079761 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-17956936-e0b2-4883-8f44-c15c85d4c7ff tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:44:36.080053 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-17956936-e0b2-4883-8f44-c15c85d4c7ff tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:44:36.080863 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-17956936-e0b2-4883-8f44-c15c85d4c7ff tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:44:36.081339 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-17956936-e0b2-4883-8f44-c15c85d4c7ff tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:44:36.226006 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-17956936-e0b2-4883-8f44-c15c85d4c7ff tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:44:36.234550 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-17956936-e0b2-4883-8f44-c15c85d4c7ff tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:44:36.236088 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-17956936-e0b2-4883-8f44-c15c85d4c7ff tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:44:36.237238 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-17956936-e0b2-4883-8f44-c15c85d4c7ff tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] 10.222.0.42 "GET /compute/v2.1/servers/ce3b66f8-03e9-4d5f-8c40-d1a887b12304" status: 200 len: 1715 microversion: 2.20 time: 0.170460 Jun 06 10:44:36.243889 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 358/736] 10.222.0.42 () {60 vars in 1276 bytes} [Mon Jun 6 10:44:36 2022] GET /compute/v2.1/servers/ce3b66f8-03e9-4d5f-8c40-d1a887b12304 => generated 1715 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 10:44:36.647900 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-016f24ee-dbb5-4e2b-b2d7-ce43efe25fce tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:44:36.650070 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-016f24ee-dbb5-4e2b-b2d7-ce43efe25fce tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] [instance: 7490171a-7d11-4bb4-ad17-852fdbd2af8b] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:44:36.659679 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-016f24ee-dbb5-4e2b-b2d7-ce43efe25fce tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:44:36.660453 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-016f24ee-dbb5-4e2b-b2d7-ce43efe25fce tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:44:36.661313 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-016f24ee-dbb5-4e2b-b2d7-ce43efe25fce tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:44:36.661839 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-016f24ee-dbb5-4e2b-b2d7-ce43efe25fce tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:44:36.734745 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-016f24ee-dbb5-4e2b-b2d7-ce43efe25fce tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ba341ea1ac34874bbfb8b2f713aea1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92244b4ae17d49bebe621e803bd9ae58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:44:36.742591 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-016f24ee-dbb5-4e2b-b2d7-ce43efe25fce tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] 10.222.0.42 "GET /compute/v2.1/servers/7490171a-7d11-4bb4-ad17-852fdbd2af8b" status: 200 len: 1298 microversion: 2.1 time: 0.098343 Jun 06 10:44:36.743174 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 379/737] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:44:36 2022] GET /compute/v2.1/servers/7490171a-7d11-4bb4-ad17-852fdbd2af8b => generated 1298 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:44:37.761282 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-4b9dd850-6fc7-4732-bb0d-41d1a291af41 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:44:37.762106 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-4b9dd850-6fc7-4732-bb0d-41d1a291af41 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] [instance: 7490171a-7d11-4bb4-ad17-852fdbd2af8b] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:44:37.769370 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-4b9dd850-6fc7-4732-bb0d-41d1a291af41 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:44:37.769958 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-4b9dd850-6fc7-4732-bb0d-41d1a291af41 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:44:37.770739 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-4b9dd850-6fc7-4732-bb0d-41d1a291af41 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:44:37.771487 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-4b9dd850-6fc7-4732-bb0d-41d1a291af41 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:44:38.032228 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-4b9dd850-6fc7-4732-bb0d-41d1a291af41 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ba341ea1ac34874bbfb8b2f713aea1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92244b4ae17d49bebe621e803bd9ae58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:44:38.040010 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-4b9dd850-6fc7-4732-bb0d-41d1a291af41 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] 10.222.0.42 "GET /compute/v2.1/servers/7490171a-7d11-4bb4-ad17-852fdbd2af8b" status: 200 len: 1364 microversion: 2.1 time: 0.283123 Jun 06 10:44:38.040570 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 359/738] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:44:37 2022] GET /compute/v2.1/servers/7490171a-7d11-4bb4-ad17-852fdbd2af8b => generated 1364 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 10:44:38.141870 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [req-f66a3575-c145-46c3-b37e-9d85066fc3da req-4cd87742-1f60-4feb-bb05-7aea113d6020 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7490171a-7d11-4bb4-ad17-852fdbd2af8b", "tag": "9608fdc9-f9d6-4de7-84db-028c5280761f"}]} {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 10:44:38.167525 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [req-f66a3575-c145-46c3-b37e-9d85066fc3da req-4cd87742-1f60-4feb-bb05-7aea113d6020 service nova] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:44:38.168075 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [req-f66a3575-c145-46c3-b37e-9d85066fc3da req-4cd87742-1f60-4feb-bb05-7aea113d6020 service nova] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:44:38.200092 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.compute.server_external_events [req-f66a3575-c145-46c3-b37e-9d85066fc3da req-4cd87742-1f60-4feb-bb05-7aea113d6020 service nova] Creating event network-changed:9608fdc9-f9d6-4de7-84db-028c5280761f for instance 7490171a-7d11-4bb4-ad17-852fdbd2af8b on hv-cinder-84482 Jun 06 10:44:38.207225 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [req-f66a3575-c145-46c3-b37e-9d85066fc3da req-4cd87742-1f60-4feb-bb05-7aea113d6020 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070017 Jun 06 10:44:38.208638 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 380/739] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Jun 6 10:44:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 10:44:39.056580 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-c2f816a1-cb84-49e3-9c1f-c14bd57e8b21 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:44:39.057227 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-c2f816a1-cb84-49e3-9c1f-c14bd57e8b21 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] [instance: 7490171a-7d11-4bb4-ad17-852fdbd2af8b] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:44:39.063810 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-c2f816a1-cb84-49e3-9c1f-c14bd57e8b21 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:44:39.064261 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-c2f816a1-cb84-49e3-9c1f-c14bd57e8b21 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:44:39.065022 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-c2f816a1-cb84-49e3-9c1f-c14bd57e8b21 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:44:39.065545 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-c2f816a1-cb84-49e3-9c1f-c14bd57e8b21 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:44:39.219380 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-c2f816a1-cb84-49e3-9c1f-c14bd57e8b21 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ba341ea1ac34874bbfb8b2f713aea1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92244b4ae17d49bebe621e803bd9ae58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:44:39.227930 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-c2f816a1-cb84-49e3-9c1f-c14bd57e8b21 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] 10.222.0.42 "GET /compute/v2.1/servers/7490171a-7d11-4bb4-ad17-852fdbd2af8b" status: 200 len: 1364 microversion: 2.1 time: 0.175090 Jun 06 10:44:39.228502 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 360/740] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:44:39 2022] GET /compute/v2.1/servers/7490171a-7d11-4bb4-ad17-852fdbd2af8b => generated 1364 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:44:40.245576 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-319b233b-f3d6-448d-874a-4f3840ec3bc8 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:44:40.246277 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-319b233b-f3d6-448d-874a-4f3840ec3bc8 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] [instance: 7490171a-7d11-4bb4-ad17-852fdbd2af8b] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:44:40.252940 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-319b233b-f3d6-448d-874a-4f3840ec3bc8 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:44:40.253388 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-319b233b-f3d6-448d-874a-4f3840ec3bc8 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:44:40.254155 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-319b233b-f3d6-448d-874a-4f3840ec3bc8 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:44:40.254593 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-319b233b-f3d6-448d-874a-4f3840ec3bc8 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:44:40.398941 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-319b233b-f3d6-448d-874a-4f3840ec3bc8 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ba341ea1ac34874bbfb8b2f713aea1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92244b4ae17d49bebe621e803bd9ae58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:44:40.408495 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-319b233b-f3d6-448d-874a-4f3840ec3bc8 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] 10.222.0.42 "GET /compute/v2.1/servers/7490171a-7d11-4bb4-ad17-852fdbd2af8b" status: 200 len: 1364 microversion: 2.1 time: 0.167718 Jun 06 10:44:40.409067 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 381/741] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:44:40 2022] GET /compute/v2.1/servers/7490171a-7d11-4bb4-ad17-852fdbd2af8b => generated 1364 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:44:41.425191 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-0e873aad-6ab9-4eb1-86b6-aaf7437453b2 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:44:41.425828 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-0e873aad-6ab9-4eb1-86b6-aaf7437453b2 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] [instance: 7490171a-7d11-4bb4-ad17-852fdbd2af8b] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:44:41.428250 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG dbcounter [-] [129350] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=3 {{(pid=129350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 10:44:41.434209 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-0e873aad-6ab9-4eb1-86b6-aaf7437453b2 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:44:41.434653 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-0e873aad-6ab9-4eb1-86b6-aaf7437453b2 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:44:41.435415 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-0e873aad-6ab9-4eb1-86b6-aaf7437453b2 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:44:41.435902 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-0e873aad-6ab9-4eb1-86b6-aaf7437453b2 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:44:41.576346 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-0e873aad-6ab9-4eb1-86b6-aaf7437453b2 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ba341ea1ac34874bbfb8b2f713aea1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92244b4ae17d49bebe621e803bd9ae58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:44:41.583698 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-0e873aad-6ab9-4eb1-86b6-aaf7437453b2 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] 10.222.0.42 "GET /compute/v2.1/servers/7490171a-7d11-4bb4-ad17-852fdbd2af8b" status: 200 len: 1364 microversion: 2.1 time: 0.162285 Jun 06 10:44:41.584287 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 361/742] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:44:41 2022] GET /compute/v2.1/servers/7490171a-7d11-4bb4-ad17-852fdbd2af8b => generated 1364 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:44:42.530475 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [req-8a2dacf8-9748-48d3-9d20-02fb76f93302 req-2f22f11a-88e0-4328-a1c2-4ebea9ded810 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7490171a-7d11-4bb4-ad17-852fdbd2af8b", "name": "network-vif-plugged", "status": "completed", "tag": "9608fdc9-f9d6-4de7-84db-028c5280761f"}]} {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 10:44:42.534714 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG dbcounter [-] [129349] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=1 {{(pid=129349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 10:44:42.542874 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [req-8a2dacf8-9748-48d3-9d20-02fb76f93302 req-2f22f11a-88e0-4328-a1c2-4ebea9ded810 service nova] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:44:42.543620 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [req-8a2dacf8-9748-48d3-9d20-02fb76f93302 req-2f22f11a-88e0-4328-a1c2-4ebea9ded810 service nova] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:44:42.556283 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.compute.server_external_events [req-8a2dacf8-9748-48d3-9d20-02fb76f93302 req-2f22f11a-88e0-4328-a1c2-4ebea9ded810 service nova] Creating event network-vif-plugged:9608fdc9-f9d6-4de7-84db-028c5280761f for instance 7490171a-7d11-4bb4-ad17-852fdbd2af8b on hv-cinder-84482 Jun 06 10:44:42.561736 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [req-8a2dacf8-9748-48d3-9d20-02fb76f93302 req-2f22f11a-88e0-4328-a1c2-4ebea9ded810 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038239 Jun 06 10:44:42.562649 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 382/743] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Jun 6 10:44:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 10:44:42.601947 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-8fc72936-86a0-4b3b-8093-1e927f5563ab tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:44:42.602563 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-8fc72936-86a0-4b3b-8093-1e927f5563ab tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] [instance: 7490171a-7d11-4bb4-ad17-852fdbd2af8b] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:44:42.609210 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-8fc72936-86a0-4b3b-8093-1e927f5563ab tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:44:42.609661 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-8fc72936-86a0-4b3b-8093-1e927f5563ab tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:44:42.610432 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-8fc72936-86a0-4b3b-8093-1e927f5563ab tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:44:42.610870 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-8fc72936-86a0-4b3b-8093-1e927f5563ab tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:44:42.905073 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-8fc72936-86a0-4b3b-8093-1e927f5563ab tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ba341ea1ac34874bbfb8b2f713aea1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92244b4ae17d49bebe621e803bd9ae58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:44:42.912411 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-8fc72936-86a0-4b3b-8093-1e927f5563ab tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] 10.222.0.42 "GET /compute/v2.1/servers/7490171a-7d11-4bb4-ad17-852fdbd2af8b" status: 200 len: 1364 microversion: 2.1 time: 0.314330 Jun 06 10:44:42.912976 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 362/744] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:44:42 2022] GET /compute/v2.1/servers/7490171a-7d11-4bb4-ad17-852fdbd2af8b => generated 1364 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:44:43.929879 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-2da82752-0b6a-4ab1-8f7d-2b3aeb77d280 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:44:43.930576 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-2da82752-0b6a-4ab1-8f7d-2b3aeb77d280 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] [instance: 7490171a-7d11-4bb4-ad17-852fdbd2af8b] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:44:43.936842 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-2da82752-0b6a-4ab1-8f7d-2b3aeb77d280 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:44:43.937287 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-2da82752-0b6a-4ab1-8f7d-2b3aeb77d280 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:44:43.938047 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-2da82752-0b6a-4ab1-8f7d-2b3aeb77d280 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:44:43.938481 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-2da82752-0b6a-4ab1-8f7d-2b3aeb77d280 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:44:44.067080 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-2da82752-0b6a-4ab1-8f7d-2b3aeb77d280 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ba341ea1ac34874bbfb8b2f713aea1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92244b4ae17d49bebe621e803bd9ae58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:44:44.075160 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-2da82752-0b6a-4ab1-8f7d-2b3aeb77d280 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] 10.222.0.42 "GET /compute/v2.1/servers/7490171a-7d11-4bb4-ad17-852fdbd2af8b" status: 200 len: 1554 microversion: 2.1 time: 0.150028 Jun 06 10:44:44.075729 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 383/745] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:44:43 2022] GET /compute/v2.1/servers/7490171a-7d11-4bb4-ad17-852fdbd2af8b => generated 1554 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:44:44.091870 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-2d738f0b-c7d7-4373-9b18-da90a84589f6 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:44:44.092402 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-2d738f0b-c7d7-4373-9b18-da90a84589f6 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] [instance: 7490171a-7d11-4bb4-ad17-852fdbd2af8b] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:44:44.098755 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-2d738f0b-c7d7-4373-9b18-da90a84589f6 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:44:44.099200 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-2d738f0b-c7d7-4373-9b18-da90a84589f6 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:44:44.099994 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-2d738f0b-c7d7-4373-9b18-da90a84589f6 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:44:44.100427 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-2d738f0b-c7d7-4373-9b18-da90a84589f6 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:44:44.180821 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-2d738f0b-c7d7-4373-9b18-da90a84589f6 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] 10.222.0.42 "GET /compute/v2.1/servers/7490171a-7d11-4bb4-ad17-852fdbd2af8b/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.093304 Jun 06 10:44:44.181427 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 363/746] 10.222.0.42 () {58 vars in 1274 bytes} [Mon Jun 6 10:44:44 2022] GET /compute/v2.1/servers/7490171a-7d11-4bb4-ad17-852fdbd2af8b/os-interface => generated 285 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 10:44:45.391165 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [req-48689f2b-b12f-4263-9f8b-b9a8848d136d req-19aa0372-0e9e-491a-b9c2-fb68f4e3d094 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7490171a-7d11-4bb4-ad17-852fdbd2af8b", "tag": "9608fdc9-f9d6-4de7-84db-028c5280761f"}]} {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 10:44:45.402052 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [req-48689f2b-b12f-4263-9f8b-b9a8848d136d req-19aa0372-0e9e-491a-b9c2-fb68f4e3d094 service nova] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:44:45.402564 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [req-48689f2b-b12f-4263-9f8b-b9a8848d136d req-19aa0372-0e9e-491a-b9c2-fb68f4e3d094 service nova] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:44:45.407609 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG dbcounter [-] [129349] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2 {{(pid=129349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 10:44:45.414799 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.compute.server_external_events [req-48689f2b-b12f-4263-9f8b-b9a8848d136d req-19aa0372-0e9e-491a-b9c2-fb68f4e3d094 service nova] Creating event network-changed:9608fdc9-f9d6-4de7-84db-028c5280761f for instance 7490171a-7d11-4bb4-ad17-852fdbd2af8b on hv-cinder-84482 Jun 06 10:44:45.420289 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [req-48689f2b-b12f-4263-9f8b-b9a8848d136d req-19aa0372-0e9e-491a-b9c2-fb68f4e3d094 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033653 Jun 06 10:44:45.420887 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 384/747] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Jun 6 10:44:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 10:44:58.152061 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG dbcounter [-] [129350] Writing DB stats nova_cell0:SELECT=2 {{(pid=129350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 10:44:58.152804 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG dbcounter [-] [129350] Writing DB stats nova_cell0:SELECT=6 {{(pid=129350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 10:44:58.153525 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG dbcounter [-] [129350] Writing DB stats nova_api:SELECT=5 {{(pid=129350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 10:44:58.154134 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG dbcounter [-] [129350] Writing DB stats nova_cell1:SELECT=84,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 10:44:58.158206 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-04ec96b3-3e3c-4f75-ab68-cce3127cbcaf tempest-VolumesSnapshotTestJSON-1359047564 tempest-VolumesSnapshotTestJSON-1359047564-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-679894924", "imageRef": "6eea2d98-354d-4083-b74c-abcbb97f9e1a", "flavorRef": "452", "networks": [{"uuid": "2a66c6fe-6386-4a4f-89e8-25ae36074d2d"}]}} {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 10:44:58.209896 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.network.neutron [None req-04ec96b3-3e3c-4f75-ab68-cce3127cbcaf tempest-VolumesSnapshotTestJSON-1359047564 tempest-VolumesSnapshotTestJSON-1359047564-project] validate_networks() for [('2a66c6fe-6386-4a4f-89e8-25ae36074d2d', None, None, None, None, None)] {{(pid=129350) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 06 10:44:58.544833 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.virt.hardware [None req-04ec96b3-3e3c-4f75-ab68-cce3127cbcaf tempest-VolumesSnapshotTestJSON-1359047564 tempest-VolumesSnapshotTestJSON-1359047564-project] Flavor limits 0:0:0 {{(pid=129350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 06 10:44:58.545253 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.virt.hardware [None req-04ec96b3-3e3c-4f75-ab68-cce3127cbcaf tempest-VolumesSnapshotTestJSON-1359047564 tempest-VolumesSnapshotTestJSON-1359047564-project] Image limits 0:0:0 {{(pid=129350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 06 10:44:58.545721 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.virt.hardware [None req-04ec96b3-3e3c-4f75-ab68-cce3127cbcaf tempest-VolumesSnapshotTestJSON-1359047564 tempest-VolumesSnapshotTestJSON-1359047564-project] Flavor pref 0:0:0 {{(pid=129350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 06 10:44:58.546152 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.virt.hardware [None req-04ec96b3-3e3c-4f75-ab68-cce3127cbcaf tempest-VolumesSnapshotTestJSON-1359047564 tempest-VolumesSnapshotTestJSON-1359047564-project] Image pref 0:0:0 {{(pid=129350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 06 10:44:58.546560 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.virt.hardware [None req-04ec96b3-3e3c-4f75-ab68-cce3127cbcaf tempest-VolumesSnapshotTestJSON-1359047564 tempest-VolumesSnapshotTestJSON-1359047564-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 06 10:44:58.555149 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-04ec96b3-3e3c-4f75-ab68-cce3127cbcaf tempest-VolumesSnapshotTestJSON-1359047564 tempest-VolumesSnapshotTestJSON-1359047564-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:44:58.555588 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-04ec96b3-3e3c-4f75-ab68-cce3127cbcaf tempest-VolumesSnapshotTestJSON-1359047564 tempest-VolumesSnapshotTestJSON-1359047564-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:44:58.557033 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-04ec96b3-3e3c-4f75-ab68-cce3127cbcaf tempest-VolumesSnapshotTestJSON-1359047564 tempest-VolumesSnapshotTestJSON-1359047564-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:44:58.557461 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-04ec96b3-3e3c-4f75-ab68-cce3127cbcaf tempest-VolumesSnapshotTestJSON-1359047564 tempest-VolumesSnapshotTestJSON-1359047564-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:44:58.574265 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.quota [None req-04ec96b3-3e3c-4f75-ab68-cce3127cbcaf tempest-VolumesSnapshotTestJSON-1359047564 tempest-VolumesSnapshotTestJSON-1359047564-project] Getting quotas for project d93c9242f08447aaa597423812d5904d. Resources: {'ram', 'cores', 'instances'} {{(pid=129350) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 06 10:44:58.577890 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.quota [None req-04ec96b3-3e3c-4f75-ab68-cce3127cbcaf tempest-VolumesSnapshotTestJSON-1359047564 tempest-VolumesSnapshotTestJSON-1359047564-project] Getting quotas for user 63d02effcaa64a2580cdd1613e7ff1d8 and project d93c9242f08447aaa597423812d5904d. Resources: {'ram', 'cores', 'instances'} {{(pid=129350) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 06 10:44:58.588691 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-04ec96b3-3e3c-4f75-ab68-cce3127cbcaf tempest-VolumesSnapshotTestJSON-1359047564 tempest-VolumesSnapshotTestJSON-1359047564-project] Going to run 1 instances... {{(pid=129350) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 06 10:44:58.590735 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-04ec96b3-3e3c-4f75-ab68-cce3127cbcaf tempest-VolumesSnapshotTestJSON-1359047564 tempest-VolumesSnapshotTestJSON-1359047564-project] [instance: bdf19a3c-b5e9-473e-af16-cbef662bcff7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6eea2d98-354d-4083-b74c-abcbb97f9e1a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129350) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 06 10:44:58.636349 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-04ec96b3-3e3c-4f75-ab68-cce3127cbcaf tempest-VolumesSnapshotTestJSON-1359047564 tempest-VolumesSnapshotTestJSON-1359047564-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.485334 Jun 06 10:44:58.636983 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 364/748] 10.222.0.42 () {60 vars in 1146 bytes} [Mon Jun 6 10:44:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 487 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 06 10:44:58.644421 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG dbcounter [-] [129349] Writing DB stats nova_cell0:SELECT=6 {{(pid=129349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 10:44:58.645885 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG dbcounter [-] [129349] Writing DB stats nova_api:SELECT=5 {{(pid=129349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 10:44:58.649859 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-51ed9915-9a65-41ac-bf27-6162606149f0 tempest-VolumesSnapshotTestJSON-1359047564 tempest-VolumesSnapshotTestJSON-1359047564-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:44:58.650548 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-51ed9915-9a65-41ac-bf27-6162606149f0 tempest-VolumesSnapshotTestJSON-1359047564 tempest-VolumesSnapshotTestJSON-1359047564-project] [instance: bdf19a3c-b5e9-473e-af16-cbef662bcff7] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:44:58.711007 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-51ed9915-9a65-41ac-bf27-6162606149f0 tempest-VolumesSnapshotTestJSON-1359047564 tempest-VolumesSnapshotTestJSON-1359047564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d02effcaa64a2580cdd1613e7ff1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd93c9242f08447aaa597423812d5904d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:44:58.717815 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-51ed9915-9a65-41ac-bf27-6162606149f0 tempest-VolumesSnapshotTestJSON-1359047564 tempest-VolumesSnapshotTestJSON-1359047564-project] 10.222.0.42 "GET /compute/v2.1/servers/bdf19a3c-b5e9-473e-af16-cbef662bcff7" status: 200 len: 1218 microversion: 2.1 time: 0.074308 Jun 06 10:44:58.718383 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 385/749] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:44:58 2022] GET /compute/v2.1/servers/bdf19a3c-b5e9-473e-af16-cbef662bcff7 => generated 1218 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:44:59.735022 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-b1e498b9-14f5-4b63-9c55-45d71452514c tempest-VolumesSnapshotTestJSON-1359047564 tempest-VolumesSnapshotTestJSON-1359047564-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:44:59.735637 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-b1e498b9-14f5-4b63-9c55-45d71452514c tempest-VolumesSnapshotTestJSON-1359047564 tempest-VolumesSnapshotTestJSON-1359047564-project] [instance: bdf19a3c-b5e9-473e-af16-cbef662bcff7] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:44:59.742453 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-b1e498b9-14f5-4b63-9c55-45d71452514c tempest-VolumesSnapshotTestJSON-1359047564 tempest-VolumesSnapshotTestJSON-1359047564-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:44:59.743266 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-b1e498b9-14f5-4b63-9c55-45d71452514c tempest-VolumesSnapshotTestJSON-1359047564 tempest-VolumesSnapshotTestJSON-1359047564-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:44:59.744070 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-b1e498b9-14f5-4b63-9c55-45d71452514c tempest-VolumesSnapshotTestJSON-1359047564 tempest-VolumesSnapshotTestJSON-1359047564-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:44:59.744665 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-b1e498b9-14f5-4b63-9c55-45d71452514c tempest-VolumesSnapshotTestJSON-1359047564 tempest-VolumesSnapshotTestJSON-1359047564-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:44:59.815675 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-b1e498b9-14f5-4b63-9c55-45d71452514c tempest-VolumesSnapshotTestJSON-1359047564 tempest-VolumesSnapshotTestJSON-1359047564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d02effcaa64a2580cdd1613e7ff1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd93c9242f08447aaa597423812d5904d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:44:59.823876 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-b1e498b9-14f5-4b63-9c55-45d71452514c tempest-VolumesSnapshotTestJSON-1359047564 tempest-VolumesSnapshotTestJSON-1359047564-project] 10.222.0.42 "GET /compute/v2.1/servers/bdf19a3c-b5e9-473e-af16-cbef662bcff7" status: 200 len: 1276 microversion: 2.1 time: 0.093052 Jun 06 10:44:59.824436 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 365/750] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:44:59 2022] GET /compute/v2.1/servers/bdf19a3c-b5e9-473e-af16-cbef662bcff7 => generated 1276 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:45:00.368925 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-f8f0e6da-cf9a-48d9-a7d6-68eeadfa2cc0 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:45:00.369548 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-f8f0e6da-cf9a-48d9-a7d6-68eeadfa2cc0 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] [instance: f835921f-5523-4063-89d9-1fe690669fb9] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:45:00.370953 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [req-bd5d038e-04dd-426e-a447-55c281c1d8ad req-40ae0e3b-8cde-412d-8d1b-b936d37dfe81 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f835921f-5523-4063-89d9-1fe690669fb9", "tag": "3a3a5f7d-eb2a-4a67-83a6-a0deab7b7e1a"}]} {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 10:45:00.384617 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-f8f0e6da-cf9a-48d9-a7d6-68eeadfa2cc0 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:45:00.385370 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-f8f0e6da-cf9a-48d9-a7d6-68eeadfa2cc0 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:45:00.386284 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-f8f0e6da-cf9a-48d9-a7d6-68eeadfa2cc0 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:45:00.387555 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [req-bd5d038e-04dd-426e-a447-55c281c1d8ad req-40ae0e3b-8cde-412d-8d1b-b936d37dfe81 service nova] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:45:00.387555 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [req-bd5d038e-04dd-426e-a447-55c281c1d8ad req-40ae0e3b-8cde-412d-8d1b-b936d37dfe81 service nova] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:45:00.387844 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-f8f0e6da-cf9a-48d9-a7d6-68eeadfa2cc0 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:45:00.402744 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.compute.server_external_events [req-bd5d038e-04dd-426e-a447-55c281c1d8ad req-40ae0e3b-8cde-412d-8d1b-b936d37dfe81 service nova] Creating event network-changed:3a3a5f7d-eb2a-4a67-83a6-a0deab7b7e1a for instance f835921f-5523-4063-89d9-1fe690669fb9 on hv-cinder-84482 Jun 06 10:45:00.409300 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [req-bd5d038e-04dd-426e-a447-55c281c1d8ad req-40ae0e3b-8cde-412d-8d1b-b936d37dfe81 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042043 Jun 06 10:45:00.411383 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 366/751] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Jun 6 10:45:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 10:45:00.426563 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-f8f0e6da-cf9a-48d9-a7d6-68eeadfa2cc0 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] [instance: f835921f-5523-4063-89d9-1fe690669fb9] Going to try to terminate instance {{(pid=129349) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 06 10:45:00.515024 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-f8f0e6da-cf9a-48d9-a7d6-68eeadfa2cc0 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] 10.222.0.42 "DELETE /compute/v2.1/servers/f835921f-5523-4063-89d9-1fe690669fb9" status: 204 len: 0 microversion: 2.1 time: 0.149833 Jun 06 10:45:00.519591 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 386/752] 10.222.0.42 () {58 vars in 1238 bytes} [Mon Jun 6 10:45:00 2022] DELETE /compute/v2.1/servers/f835921f-5523-4063-89d9-1fe690669fb9 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 06 10:45:00.525555 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-01d1ba92-afec-43bd-a2d8-18e4566f4096 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:45:00.526258 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-01d1ba92-afec-43bd-a2d8-18e4566f4096 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] [instance: f835921f-5523-4063-89d9-1fe690669fb9] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:45:00.532688 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-01d1ba92-afec-43bd-a2d8-18e4566f4096 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:45:00.533346 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-01d1ba92-afec-43bd-a2d8-18e4566f4096 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:45:00.534115 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-01d1ba92-afec-43bd-a2d8-18e4566f4096 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:45:00.534550 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-01d1ba92-afec-43bd-a2d8-18e4566f4096 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:45:00.747719 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-01d1ba92-afec-43bd-a2d8-18e4566f4096 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d09fe912b4c4cab81b00df801f69680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2496096b374f399606bff9a08b65eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:45:00.756016 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-01d1ba92-afec-43bd-a2d8-18e4566f4096 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] 10.222.0.42 "GET /compute/v2.1/servers/f835921f-5523-4063-89d9-1fe690669fb9" status: 200 len: 1569 microversion: 2.1 time: 0.235098 Jun 06 10:45:00.756893 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 367/753] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:45:00 2022] GET /compute/v2.1/servers/f835921f-5523-4063-89d9-1fe690669fb9 => generated 1569 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 10:45:00.843915 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-0430bb64-a5a1-4759-99fc-4682d02438b3 tempest-VolumesSnapshotTestJSON-1359047564 tempest-VolumesSnapshotTestJSON-1359047564-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:45:00.844762 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-0430bb64-a5a1-4759-99fc-4682d02438b3 tempest-VolumesSnapshotTestJSON-1359047564 tempest-VolumesSnapshotTestJSON-1359047564-project] [instance: bdf19a3c-b5e9-473e-af16-cbef662bcff7] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:45:00.852832 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-0430bb64-a5a1-4759-99fc-4682d02438b3 tempest-VolumesSnapshotTestJSON-1359047564 tempest-VolumesSnapshotTestJSON-1359047564-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:45:00.853333 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-0430bb64-a5a1-4759-99fc-4682d02438b3 tempest-VolumesSnapshotTestJSON-1359047564 tempest-VolumesSnapshotTestJSON-1359047564-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:45:00.854039 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-0430bb64-a5a1-4759-99fc-4682d02438b3 tempest-VolumesSnapshotTestJSON-1359047564 tempest-VolumesSnapshotTestJSON-1359047564-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:45:00.854685 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-0430bb64-a5a1-4759-99fc-4682d02438b3 tempest-VolumesSnapshotTestJSON-1359047564 tempest-VolumesSnapshotTestJSON-1359047564-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:45:01.062105 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-0430bb64-a5a1-4759-99fc-4682d02438b3 tempest-VolumesSnapshotTestJSON-1359047564 tempest-VolumesSnapshotTestJSON-1359047564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d02effcaa64a2580cdd1613e7ff1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd93c9242f08447aaa597423812d5904d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:45:01.069588 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-0430bb64-a5a1-4759-99fc-4682d02438b3 tempest-VolumesSnapshotTestJSON-1359047564 tempest-VolumesSnapshotTestJSON-1359047564-project] 10.222.0.42 "GET /compute/v2.1/servers/bdf19a3c-b5e9-473e-af16-cbef662bcff7" status: 200 len: 1318 microversion: 2.1 time: 0.231847 Jun 06 10:45:01.070155 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 387/754] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:45:00 2022] GET /compute/v2.1/servers/bdf19a3c-b5e9-473e-af16-cbef662bcff7 => generated 1318 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 10:45:01.192503 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [req-8eebc356-1aae-452b-8626-2865de60f30b req-bfcab661-9b9b-4996-92bc-f1174633dabd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bdf19a3c-b5e9-473e-af16-cbef662bcff7", "tag": "aae716a7-eb09-4f8a-a229-e598143818e8"}]} {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 10:45:01.201612 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [req-8eebc356-1aae-452b-8626-2865de60f30b req-bfcab661-9b9b-4996-92bc-f1174633dabd service nova] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:45:01.202242 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [req-8eebc356-1aae-452b-8626-2865de60f30b req-bfcab661-9b9b-4996-92bc-f1174633dabd service nova] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:45:01.222787 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.compute.server_external_events [req-8eebc356-1aae-452b-8626-2865de60f30b req-bfcab661-9b9b-4996-92bc-f1174633dabd service nova] Creating event network-changed:aae716a7-eb09-4f8a-a229-e598143818e8 for instance bdf19a3c-b5e9-473e-af16-cbef662bcff7 on hv-cinder-84482 Jun 06 10:45:01.227973 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [req-8eebc356-1aae-452b-8626-2865de60f30b req-bfcab661-9b9b-4996-92bc-f1174633dabd service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038592 Jun 06 10:45:01.228539 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 368/755] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Jun 6 10:45:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 10:45:01.775119 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-5e28aaa0-806e-4ffe-b643-9a921dfac774 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:45:01.775764 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-5e28aaa0-806e-4ffe-b643-9a921dfac774 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] [instance: f835921f-5523-4063-89d9-1fe690669fb9] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:45:01.782425 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-5e28aaa0-806e-4ffe-b643-9a921dfac774 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:45:01.782942 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-5e28aaa0-806e-4ffe-b643-9a921dfac774 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:45:01.783714 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-5e28aaa0-806e-4ffe-b643-9a921dfac774 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:45:01.784165 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-5e28aaa0-806e-4ffe-b643-9a921dfac774 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:45:02.029956 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-5e28aaa0-806e-4ffe-b643-9a921dfac774 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d09fe912b4c4cab81b00df801f69680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2496096b374f399606bff9a08b65eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:45:02.037647 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-5e28aaa0-806e-4ffe-b643-9a921dfac774 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] 10.222.0.42 "GET /compute/v2.1/servers/f835921f-5523-4063-89d9-1fe690669fb9" status: 200 len: 1569 microversion: 2.1 time: 0.267508 Jun 06 10:45:02.038246 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 388/756] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:45:01 2022] GET /compute/v2.1/servers/f835921f-5523-4063-89d9-1fe690669fb9 => generated 1569 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:45:02.089037 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-cbf91771-2dfc-481f-a419-75068a58cbc9 tempest-VolumesSnapshotTestJSON-1359047564 tempest-VolumesSnapshotTestJSON-1359047564-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:45:02.089855 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-cbf91771-2dfc-481f-a419-75068a58cbc9 tempest-VolumesSnapshotTestJSON-1359047564 tempest-VolumesSnapshotTestJSON-1359047564-project] [instance: bdf19a3c-b5e9-473e-af16-cbef662bcff7] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:45:02.096095 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-cbf91771-2dfc-481f-a419-75068a58cbc9 tempest-VolumesSnapshotTestJSON-1359047564 tempest-VolumesSnapshotTestJSON-1359047564-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:45:02.096541 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-cbf91771-2dfc-481f-a419-75068a58cbc9 tempest-VolumesSnapshotTestJSON-1359047564 tempest-VolumesSnapshotTestJSON-1359047564-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:45:02.097298 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-cbf91771-2dfc-481f-a419-75068a58cbc9 tempest-VolumesSnapshotTestJSON-1359047564 tempest-VolumesSnapshotTestJSON-1359047564-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:45:02.097732 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-cbf91771-2dfc-481f-a419-75068a58cbc9 tempest-VolumesSnapshotTestJSON-1359047564 tempest-VolumesSnapshotTestJSON-1359047564-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:45:02.354183 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-cbf91771-2dfc-481f-a419-75068a58cbc9 tempest-VolumesSnapshotTestJSON-1359047564 tempest-VolumesSnapshotTestJSON-1359047564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d02effcaa64a2580cdd1613e7ff1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd93c9242f08447aaa597423812d5904d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:45:02.361969 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-cbf91771-2dfc-481f-a419-75068a58cbc9 tempest-VolumesSnapshotTestJSON-1359047564 tempest-VolumesSnapshotTestJSON-1359047564-project] 10.222.0.42 "GET /compute/v2.1/servers/bdf19a3c-b5e9-473e-af16-cbef662bcff7" status: 200 len: 1318 microversion: 2.1 time: 0.278160 Jun 06 10:45:02.362524 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 369/757] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:45:02 2022] GET /compute/v2.1/servers/bdf19a3c-b5e9-473e-af16-cbef662bcff7 => generated 1318 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:45:02.696499 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [req-70f0e686-c0d2-4f18-8c2c-f5ae0c80e2d2 req-07112ff4-e1a2-4713-9368-25dd3d4f7c67 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f835921f-5523-4063-89d9-1fe690669fb9", "name": "network-vif-deleted", "tag": "3a3a5f7d-eb2a-4a67-83a6-a0deab7b7e1a"}]} {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 10:45:02.705351 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [req-70f0e686-c0d2-4f18-8c2c-f5ae0c80e2d2 req-07112ff4-e1a2-4713-9368-25dd3d4f7c67 service nova] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:45:02.705787 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [req-70f0e686-c0d2-4f18-8c2c-f5ae0c80e2d2 req-07112ff4-e1a2-4713-9368-25dd3d4f7c67 service nova] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:45:02.721019 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.compute.server_external_events [req-70f0e686-c0d2-4f18-8c2c-f5ae0c80e2d2 req-07112ff4-e1a2-4713-9368-25dd3d4f7c67 service nova] Creating event network-vif-deleted:3a3a5f7d-eb2a-4a67-83a6-a0deab7b7e1a for instance f835921f-5523-4063-89d9-1fe690669fb9 on hv-cinder-84482 Jun 06 10:45:02.725819 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [req-70f0e686-c0d2-4f18-8c2c-f5ae0c80e2d2 req-07112ff4-e1a2-4713-9368-25dd3d4f7c67 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034827 Jun 06 10:45:02.726581 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 389/758] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Jun 6 10:45:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 10:45:03.054465 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-9c93c5ad-d603-4e8b-9a61-61f97cc1bb0c tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:45:03.055099 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-9c93c5ad-d603-4e8b-9a61-61f97cc1bb0c tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] [instance: f835921f-5523-4063-89d9-1fe690669fb9] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:45:03.061759 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-9c93c5ad-d603-4e8b-9a61-61f97cc1bb0c tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:45:03.062209 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-9c93c5ad-d603-4e8b-9a61-61f97cc1bb0c tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:45:03.062988 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-9c93c5ad-d603-4e8b-9a61-61f97cc1bb0c tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:45:03.063426 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-9c93c5ad-d603-4e8b-9a61-61f97cc1bb0c tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:45:03.125488 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-9c93c5ad-d603-4e8b-9a61-61f97cc1bb0c tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d09fe912b4c4cab81b00df801f69680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2496096b374f399606bff9a08b65eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:45:03.132880 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-9c93c5ad-d603-4e8b-9a61-61f97cc1bb0c tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] 10.222.0.42 "GET /compute/v2.1/servers/f835921f-5523-4063-89d9-1fe690669fb9" status: 200 len: 1220 microversion: 2.1 time: 0.082283 Jun 06 10:45:03.133426 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 370/759] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:45:03 2022] GET /compute/v2.1/servers/f835921f-5523-4063-89d9-1fe690669fb9 => generated 1220 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:45:03.379242 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-e9d6b23a-4341-4f0d-906e-4f4debc9576e tempest-VolumesSnapshotTestJSON-1359047564 tempest-VolumesSnapshotTestJSON-1359047564-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:45:03.379909 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-e9d6b23a-4341-4f0d-906e-4f4debc9576e tempest-VolumesSnapshotTestJSON-1359047564 tempest-VolumesSnapshotTestJSON-1359047564-project] [instance: bdf19a3c-b5e9-473e-af16-cbef662bcff7] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:45:03.387650 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-e9d6b23a-4341-4f0d-906e-4f4debc9576e tempest-VolumesSnapshotTestJSON-1359047564 tempest-VolumesSnapshotTestJSON-1359047564-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:45:03.388155 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-e9d6b23a-4341-4f0d-906e-4f4debc9576e tempest-VolumesSnapshotTestJSON-1359047564 tempest-VolumesSnapshotTestJSON-1359047564-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:45:03.389118 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-e9d6b23a-4341-4f0d-906e-4f4debc9576e tempest-VolumesSnapshotTestJSON-1359047564 tempest-VolumesSnapshotTestJSON-1359047564-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:45:03.389542 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-e9d6b23a-4341-4f0d-906e-4f4debc9576e tempest-VolumesSnapshotTestJSON-1359047564 tempest-VolumesSnapshotTestJSON-1359047564-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:45:03.520299 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-e9d6b23a-4341-4f0d-906e-4f4debc9576e tempest-VolumesSnapshotTestJSON-1359047564 tempest-VolumesSnapshotTestJSON-1359047564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d02effcaa64a2580cdd1613e7ff1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd93c9242f08447aaa597423812d5904d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:45:03.528724 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-e9d6b23a-4341-4f0d-906e-4f4debc9576e tempest-VolumesSnapshotTestJSON-1359047564 tempest-VolumesSnapshotTestJSON-1359047564-project] 10.222.0.42 "GET /compute/v2.1/servers/bdf19a3c-b5e9-473e-af16-cbef662bcff7" status: 200 len: 1318 microversion: 2.1 time: 0.153793 Jun 06 10:45:03.529280 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 390/760] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:45:03 2022] GET /compute/v2.1/servers/bdf19a3c-b5e9-473e-af16-cbef662bcff7 => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:45:04.150050 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-5d81d92a-ee55-4f7e-ae7d-3f9f75101bd9 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:45:04.150662 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-5d81d92a-ee55-4f7e-ae7d-3f9f75101bd9 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] [instance: f835921f-5523-4063-89d9-1fe690669fb9] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:45:04.157084 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-5d81d92a-ee55-4f7e-ae7d-3f9f75101bd9 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:45:04.157533 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-5d81d92a-ee55-4f7e-ae7d-3f9f75101bd9 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:45:04.158323 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-5d81d92a-ee55-4f7e-ae7d-3f9f75101bd9 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:45:04.158764 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-5d81d92a-ee55-4f7e-ae7d-3f9f75101bd9 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:45:04.193958 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-5d81d92a-ee55-4f7e-ae7d-3f9f75101bd9 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:45:04.193958 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-5d81d92a-ee55-4f7e-ae7d-3f9f75101bd9 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:45:04.194346 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.objects.instance [None req-5d81d92a-ee55-4f7e-ae7d-3f9f75101bd9 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Lazy-loading 'fault' on Instance uuid f835921f-5523-4063-89d9-1fe690669fb9 {{(pid=129350) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 06 10:45:04.239519 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-5d81d92a-ee55-4f7e-ae7d-3f9f75101bd9 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d09fe912b4c4cab81b00df801f69680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2496096b374f399606bff9a08b65eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:45:04.248165 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-5d81d92a-ee55-4f7e-ae7d-3f9f75101bd9 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] 10.222.0.42 "GET /compute/v2.1/servers/f835921f-5523-4063-89d9-1fe690669fb9" status: 200 len: 1225 microversion: 2.1 time: 0.101974 Jun 06 10:45:04.248791 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 371/761] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:45:04 2022] GET /compute/v2.1/servers/f835921f-5523-4063-89d9-1fe690669fb9 => generated 1225 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:45:04.546031 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-cd05e8e5-7ae1-461d-82a6-f74c51590b3f tempest-VolumesSnapshotTestJSON-1359047564 tempest-VolumesSnapshotTestJSON-1359047564-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:45:04.546653 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-cd05e8e5-7ae1-461d-82a6-f74c51590b3f tempest-VolumesSnapshotTestJSON-1359047564 tempest-VolumesSnapshotTestJSON-1359047564-project] [instance: bdf19a3c-b5e9-473e-af16-cbef662bcff7] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:45:04.553143 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-cd05e8e5-7ae1-461d-82a6-f74c51590b3f tempest-VolumesSnapshotTestJSON-1359047564 tempest-VolumesSnapshotTestJSON-1359047564-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:45:04.553607 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-cd05e8e5-7ae1-461d-82a6-f74c51590b3f tempest-VolumesSnapshotTestJSON-1359047564 tempest-VolumesSnapshotTestJSON-1359047564-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:45:04.554367 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-cd05e8e5-7ae1-461d-82a6-f74c51590b3f tempest-VolumesSnapshotTestJSON-1359047564 tempest-VolumesSnapshotTestJSON-1359047564-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:45:04.554802 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-cd05e8e5-7ae1-461d-82a6-f74c51590b3f tempest-VolumesSnapshotTestJSON-1359047564 tempest-VolumesSnapshotTestJSON-1359047564-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:45:04.688804 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-cd05e8e5-7ae1-461d-82a6-f74c51590b3f tempest-VolumesSnapshotTestJSON-1359047564 tempest-VolumesSnapshotTestJSON-1359047564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d02effcaa64a2580cdd1613e7ff1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd93c9242f08447aaa597423812d5904d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:45:04.696644 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-cd05e8e5-7ae1-461d-82a6-f74c51590b3f tempest-VolumesSnapshotTestJSON-1359047564 tempest-VolumesSnapshotTestJSON-1359047564-project] 10.222.0.42 "GET /compute/v2.1/servers/bdf19a3c-b5e9-473e-af16-cbef662bcff7" status: 200 len: 1318 microversion: 2.1 time: 0.154232 Jun 06 10:45:04.697352 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 391/762] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:45:04 2022] GET /compute/v2.1/servers/bdf19a3c-b5e9-473e-af16-cbef662bcff7 => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:45:05.265667 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-4627b68f-5a38-42a7-93cd-b12043c00572 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:45:05.266276 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-4627b68f-5a38-42a7-93cd-b12043c00572 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] [instance: f835921f-5523-4063-89d9-1fe690669fb9] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:45:05.272801 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-4627b68f-5a38-42a7-93cd-b12043c00572 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:45:05.273247 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-4627b68f-5a38-42a7-93cd-b12043c00572 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:45:05.274006 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-4627b68f-5a38-42a7-93cd-b12043c00572 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:45:05.274996 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-4627b68f-5a38-42a7-93cd-b12043c00572 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:45:05.297943 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.wsgi [None req-4627b68f-5a38-42a7-93cd-b12043c00572 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] HTTP exception thrown: Instance f835921f-5523-4063-89d9-1fe690669fb9 could not be found. Jun 06 10:45:05.299589 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-4627b68f-5a38-42a7-93cd-b12043c00572 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Request method failure captured: Jun 06 10:45:05.299589 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: request: GET /compute/v2.1/servers/f835921f-5523-4063-89d9-1fe690669fb9 HTTP/1.1 Jun 06 10:45:05.299589 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: Accept: application/json Jun 06 10:45:05.299589 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: Accept-Encoding: identity Jun 06 10:45:05.299589 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: Connection: close Jun 06 10:45:05.299589 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: Content-Length: 0 Jun 06 10:45:05.299589 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: Content-Type: application/json Jun 06 10:45:05.299589 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: Host: 10.222.0.42 Jun 06 10:45:05.299589 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: Openstack-System-Scope: None Jun 06 10:45:05.299589 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: User-Agent: python-urllib3/1.26.9 Jun 06 10:45:05.299589 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Auth-Token: gAAAAABindl3d8Kcm0-sbLG67euBNMsTnvlJmKntLci1lJAToMK8H6BFbilYqRiZbL0bYS4mHEIbDj4rlJ7f1AOHTS1s8lq-_Bb527WcnYtzYiH0oL71HcXZytAKA9j0pRPMTcaqFiQ9r5F85ypVkArLjz2_N2zB04hGSMUBH8TAfZEHkgkzMck Jun 06 10:45:05.299589 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Domain-Id: None Jun 06 10:45:05.299589 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Domain-Name: None Jun 06 10:45:05.299589 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Identity-Status: Confirmed Jun 06 10:45:05.299589 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Is-Admin-Project: True Jun 06 10:45:05.299589 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Project-Domain-Id: default Jun 06 10:45:05.299589 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Project-Domain-Name: Default Jun 06 10:45:05.299589 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Project-Id: ef2496096b374f399606bff9a08b65eb Jun 06 10:45:05.299589 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Project-Name: tempest-TestShelveInstance-544898719 Jun 06 10:45:05.299589 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Role: member,reader Jun 06 10:45:05.299589 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Roles: member,reader Jun 06 10:45:05.301293 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/ef2496096b374f399606bff9a08b65eb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/ef2496096b374f399606bff9a08b65eb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/ef2496096b374f399606bff9a08b65eb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_ef2496096b374f399606bff9a08b65eb", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Jun 06 10:45:05.301293 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Tenant: tempest-TestShelveInstance-544898719 Jun 06 10:45:05.301293 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Tenant-Id: ef2496096b374f399606bff9a08b65eb Jun 06 10:45:05.301293 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Tenant-Name: tempest-TestShelveInstance-544898719 Jun 06 10:45:05.301293 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-User: tempest-TestShelveInstance-544898719-project Jun 06 10:45:05.301293 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-User-Domain-Id: default Jun 06 10:45:05.301293 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-User-Domain-Name: Default Jun 06 10:45:05.301293 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-User-Id: 6d09fe912b4c4cab81b00df801f69680 Jun 06 10:45:05.301293 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-User-Name: tempest-TestShelveInstance-544898719-project Jun 06 10:45:05.301293 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: method: > Jun 06 10:45:05.301293 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: exception: Instance f835921f-5523-4063-89d9-1fe690669fb9 could not be found. Jun 06 10:45:05.301293 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: action_args: {'id': 'f835921f-5523-4063-89d9-1fe690669fb9'} Jun 06 10:45:05.302238 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 10:45:05.302238 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 10:45:05.302238 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 06 10:45:05.302238 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 06 10:45:05.302238 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 06 10:45:05.302238 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 06 10:45:05.302238 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 06 10:45:05.302238 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 06 10:45:05.302238 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 06 10:45:05.302238 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 06 10:45:05.302238 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f835921f-5523-4063-89d9-1fe690669fb9 could not be found. Jun 06 10:45:05.302238 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi Jun 06 10:45:05.302238 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 10:45:05.302238 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi Jun 06 10:45:05.302238 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 10:45:05.302238 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 10:45:05.302238 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 10:45:05.302238 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 10:45:05.302238 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 10:45:05.302238 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 10:45:05.303972 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 10:45:05.303972 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 06 10:45:05.303972 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 06 10:45:05.303972 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 06 10:45:05.303972 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 06 10:45:05.303972 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 06 10:45:05.303972 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 06 10:45:05.303972 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f835921f-5523-4063-89d9-1fe690669fb9 could not be found. Jun 06 10:45:05.303972 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi Jun 06 10:45:05.303972 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 10:45:05.303972 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi Jun 06 10:45:05.303972 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 10:45:05.303972 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 10:45:05.303972 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 10:45:05.303972 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 10:45:05.303972 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 10:45:05.303972 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f835921f-5523-4063-89d9-1fe690669fb9 could not be found. Jun 06 10:45:05.303972 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi Jun 06 10:45:05.305595 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-4627b68f-5a38-42a7-93cd-b12043c00572 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Returning 404 to user: Instance f835921f-5523-4063-89d9-1fe690669fb9 could not be found. {{(pid=129350) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 10:45:05.305595 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-4627b68f-5a38-42a7-93cd-b12043c00572 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] 10.222.0.42 "GET /compute/v2.1/servers/f835921f-5523-4063-89d9-1fe690669fb9" status: 404 len: 111 microversion: 2.1 time: 0.039505 Jun 06 10:45:05.305595 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 372/763] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:45:05 2022] GET /compute/v2.1/servers/f835921f-5523-4063-89d9-1fe690669fb9 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 06 10:45:05.462124 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-422ccfd2-b65d-448a-a071-dea4443e9689 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] Calling method '.version_select at 0x7f8fd81d0820>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:45:05.480950 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-422ccfd2-b65d-448a-a071-dea4443e9689 tempest-TestShelveInstance-544898719 tempest-TestShelveInstance-544898719-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1759320847" status: 202 len: 0 microversion: 2.1 time: 0.023085 Jun 06 10:45:05.481530 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 392/764] 10.222.0.42 () {58 vars in 1253 bytes} [Mon Jun 6 10:45:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1759320847 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 06 10:45:05.713969 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-5a0495fb-8d1f-4c27-a7e8-41d9ccb7677b tempest-VolumesSnapshotTestJSON-1359047564 tempest-VolumesSnapshotTestJSON-1359047564-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:45:05.714580 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-5a0495fb-8d1f-4c27-a7e8-41d9ccb7677b tempest-VolumesSnapshotTestJSON-1359047564 tempest-VolumesSnapshotTestJSON-1359047564-project] [instance: bdf19a3c-b5e9-473e-af16-cbef662bcff7] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:45:05.720606 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-5a0495fb-8d1f-4c27-a7e8-41d9ccb7677b tempest-VolumesSnapshotTestJSON-1359047564 tempest-VolumesSnapshotTestJSON-1359047564-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:45:05.721053 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-5a0495fb-8d1f-4c27-a7e8-41d9ccb7677b tempest-VolumesSnapshotTestJSON-1359047564 tempest-VolumesSnapshotTestJSON-1359047564-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:45:05.721810 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-5a0495fb-8d1f-4c27-a7e8-41d9ccb7677b tempest-VolumesSnapshotTestJSON-1359047564 tempest-VolumesSnapshotTestJSON-1359047564-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:45:05.722241 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-5a0495fb-8d1f-4c27-a7e8-41d9ccb7677b tempest-VolumesSnapshotTestJSON-1359047564 tempest-VolumesSnapshotTestJSON-1359047564-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:45:05.856574 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-5a0495fb-8d1f-4c27-a7e8-41d9ccb7677b tempest-VolumesSnapshotTestJSON-1359047564 tempest-VolumesSnapshotTestJSON-1359047564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d02effcaa64a2580cdd1613e7ff1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd93c9242f08447aaa597423812d5904d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:45:05.863908 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-5a0495fb-8d1f-4c27-a7e8-41d9ccb7677b tempest-VolumesSnapshotTestJSON-1359047564 tempest-VolumesSnapshotTestJSON-1359047564-project] 10.222.0.42 "GET /compute/v2.1/servers/bdf19a3c-b5e9-473e-af16-cbef662bcff7" status: 200 len: 1318 microversion: 2.1 time: 0.154442 Jun 06 10:45:05.864627 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 373/765] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:45:05 2022] GET /compute/v2.1/servers/bdf19a3c-b5e9-473e-af16-cbef662bcff7 => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:45:06.628332 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [req-e5485531-877f-48fd-b1b2-7595d76292cd req-9f49b2b7-795e-474b-97d9-876561795b2c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bdf19a3c-b5e9-473e-af16-cbef662bcff7", "name": "network-vif-plugged", "status": "completed", "tag": "aae716a7-eb09-4f8a-a229-e598143818e8"}]} {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 10:45:06.638347 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [req-e5485531-877f-48fd-b1b2-7595d76292cd req-9f49b2b7-795e-474b-97d9-876561795b2c service nova] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:45:06.639238 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [req-e5485531-877f-48fd-b1b2-7595d76292cd req-9f49b2b7-795e-474b-97d9-876561795b2c service nova] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:45:06.651825 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.compute.server_external_events [req-e5485531-877f-48fd-b1b2-7595d76292cd req-9f49b2b7-795e-474b-97d9-876561795b2c service nova] Creating event network-vif-plugged:aae716a7-eb09-4f8a-a229-e598143818e8 for instance bdf19a3c-b5e9-473e-af16-cbef662bcff7 on hv-cinder-84482 Jun 06 10:45:06.658191 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [req-e5485531-877f-48fd-b1b2-7595d76292cd req-9f49b2b7-795e-474b-97d9-876561795b2c service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033607 Jun 06 10:45:06.659078 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 393/766] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Jun 6 10:45:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 06 10:45:06.881281 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-3b0629d2-0ea4-4af6-b877-d906ef2e06e0 tempest-VolumesSnapshotTestJSON-1359047564 tempest-VolumesSnapshotTestJSON-1359047564-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:45:06.882109 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-3b0629d2-0ea4-4af6-b877-d906ef2e06e0 tempest-VolumesSnapshotTestJSON-1359047564 tempest-VolumesSnapshotTestJSON-1359047564-project] [instance: bdf19a3c-b5e9-473e-af16-cbef662bcff7] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:45:06.889699 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-3b0629d2-0ea4-4af6-b877-d906ef2e06e0 tempest-VolumesSnapshotTestJSON-1359047564 tempest-VolumesSnapshotTestJSON-1359047564-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:45:06.890429 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-3b0629d2-0ea4-4af6-b877-d906ef2e06e0 tempest-VolumesSnapshotTestJSON-1359047564 tempest-VolumesSnapshotTestJSON-1359047564-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:45:06.891468 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-3b0629d2-0ea4-4af6-b877-d906ef2e06e0 tempest-VolumesSnapshotTestJSON-1359047564 tempest-VolumesSnapshotTestJSON-1359047564-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:45:06.892286 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-3b0629d2-0ea4-4af6-b877-d906ef2e06e0 tempest-VolumesSnapshotTestJSON-1359047564 tempest-VolumesSnapshotTestJSON-1359047564-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:45:07.034469 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-3b0629d2-0ea4-4af6-b877-d906ef2e06e0 tempest-VolumesSnapshotTestJSON-1359047564 tempest-VolumesSnapshotTestJSON-1359047564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d02effcaa64a2580cdd1613e7ff1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd93c9242f08447aaa597423812d5904d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:45:07.042535 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-3b0629d2-0ea4-4af6-b877-d906ef2e06e0 tempest-VolumesSnapshotTestJSON-1359047564 tempest-VolumesSnapshotTestJSON-1359047564-project] 10.222.0.42 "GET /compute/v2.1/servers/bdf19a3c-b5e9-473e-af16-cbef662bcff7" status: 200 len: 1318 microversion: 2.1 time: 0.165425 Jun 06 10:45:07.043090 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 374/767] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:45:06 2022] GET /compute/v2.1/servers/bdf19a3c-b5e9-473e-af16-cbef662bcff7 => generated 1318 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:45:08.061864 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-5caa07a3-d7f1-4b72-b923-396093bebf06 tempest-VolumesSnapshotTestJSON-1359047564 tempest-VolumesSnapshotTestJSON-1359047564-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:45:08.062975 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-5caa07a3-d7f1-4b72-b923-396093bebf06 tempest-VolumesSnapshotTestJSON-1359047564 tempest-VolumesSnapshotTestJSON-1359047564-project] [instance: bdf19a3c-b5e9-473e-af16-cbef662bcff7] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:45:08.071517 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-5caa07a3-d7f1-4b72-b923-396093bebf06 tempest-VolumesSnapshotTestJSON-1359047564 tempest-VolumesSnapshotTestJSON-1359047564-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:45:08.071991 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-5caa07a3-d7f1-4b72-b923-396093bebf06 tempest-VolumesSnapshotTestJSON-1359047564 tempest-VolumesSnapshotTestJSON-1359047564-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:45:08.073511 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-5caa07a3-d7f1-4b72-b923-396093bebf06 tempest-VolumesSnapshotTestJSON-1359047564 tempest-VolumesSnapshotTestJSON-1359047564-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:45:08.073958 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-5caa07a3-d7f1-4b72-b923-396093bebf06 tempest-VolumesSnapshotTestJSON-1359047564 tempest-VolumesSnapshotTestJSON-1359047564-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:45:08.590920 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-5caa07a3-d7f1-4b72-b923-396093bebf06 tempest-VolumesSnapshotTestJSON-1359047564 tempest-VolumesSnapshotTestJSON-1359047564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d02effcaa64a2580cdd1613e7ff1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd93c9242f08447aaa597423812d5904d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:45:08.600106 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-5caa07a3-d7f1-4b72-b923-396093bebf06 tempest-VolumesSnapshotTestJSON-1359047564 tempest-VolumesSnapshotTestJSON-1359047564-project] 10.222.0.42 "GET /compute/v2.1/servers/bdf19a3c-b5e9-473e-af16-cbef662bcff7" status: 200 len: 1318 microversion: 2.1 time: 0.542589 Jun 06 10:45:08.601503 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 394/768] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:45:08 2022] GET /compute/v2.1/servers/bdf19a3c-b5e9-473e-af16-cbef662bcff7 => generated 1318 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:45:09.342912 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-58f80136-a2f9-4974-9627-9820a7654369 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:45:09.343859 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-58f80136-a2f9-4974-9627-9820a7654369 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] [instance: ce3b66f8-03e9-4d5f-8c40-d1a887b12304] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:45:09.347233 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG dbcounter [-] [129350] Writing DB stats nova_cell0:SELECT=2 {{(pid=129350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 10:45:09.348034 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG dbcounter [-] [129350] Writing DB stats nova_cell0:SELECT=6 {{(pid=129350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 10:45:09.352109 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-58f80136-a2f9-4974-9627-9820a7654369 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:45:09.352558 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-58f80136-a2f9-4974-9627-9820a7654369 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:45:09.353330 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-58f80136-a2f9-4974-9627-9820a7654369 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:45:09.353766 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-58f80136-a2f9-4974-9627-9820a7654369 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:45:09.384858 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-58f80136-a2f9-4974-9627-9820a7654369 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] 10.222.0.42 "GET /compute/v2.1/servers/ce3b66f8-03e9-4d5f-8c40-d1a887b12304/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.045792 Jun 06 10:45:09.386055 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 375/769] 10.222.0.42 () {60 vars in 1342 bytes} [Mon Jun 6 10:45:09 2022] GET /compute/v2.1/servers/ce3b66f8-03e9-4d5f-8c40-d1a887b12304/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:45:09.448990 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-ff8911ef-d877-4b97-be32-c8e6be175845 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:45:09.449478 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-ff8911ef-d877-4b97-be32-c8e6be175845 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] [instance: ce3b66f8-03e9-4d5f-8c40-d1a887b12304] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:45:09.451476 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG dbcounter [-] [129349] Writing DB stats nova_cell0:SELECT=2 {{(pid=129349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 10:45:09.457799 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-ff8911ef-d877-4b97-be32-c8e6be175845 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:45:09.458231 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-ff8911ef-d877-4b97-be32-c8e6be175845 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:45:09.459002 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-ff8911ef-d877-4b97-be32-c8e6be175845 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:45:09.459435 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-ff8911ef-d877-4b97-be32-c8e6be175845 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:45:09.485844 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-ff8911ef-d877-4b97-be32-c8e6be175845 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] [instance: ce3b66f8-03e9-4d5f-8c40-d1a887b12304] Going to try to terminate instance {{(pid=129349) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 06 10:45:09.562611 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-ff8911ef-d877-4b97-be32-c8e6be175845 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] 10.222.0.42 "DELETE /compute/v2.1/servers/ce3b66f8-03e9-4d5f-8c40-d1a887b12304" status: 204 len: 0 microversion: 2.20 time: 0.117487 Jun 06 10:45:09.563424 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 395/770] 10.222.0.42 () {60 vars in 1279 bytes} [Mon Jun 6 10:45:09 2022] DELETE /compute/v2.1/servers/ce3b66f8-03e9-4d5f-8c40-d1a887b12304 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 06 10:45:09.571523 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-26ea7f03-df51-4fe5-8ad3-fe8eeb484c67 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:45:09.572288 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-26ea7f03-df51-4fe5-8ad3-fe8eeb484c67 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] [instance: ce3b66f8-03e9-4d5f-8c40-d1a887b12304] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:45:09.578210 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-26ea7f03-df51-4fe5-8ad3-fe8eeb484c67 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:45:09.578653 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-26ea7f03-df51-4fe5-8ad3-fe8eeb484c67 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:45:09.579410 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-26ea7f03-df51-4fe5-8ad3-fe8eeb484c67 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:45:09.579868 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-26ea7f03-df51-4fe5-8ad3-fe8eeb484c67 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:45:09.619433 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-6b498bd5-baa7-4c32-93b2-9eb29adfe94e tempest-VolumesSnapshotTestJSON-1359047564 tempest-VolumesSnapshotTestJSON-1359047564-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:45:09.620376 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-6b498bd5-baa7-4c32-93b2-9eb29adfe94e tempest-VolumesSnapshotTestJSON-1359047564 tempest-VolumesSnapshotTestJSON-1359047564-project] [instance: bdf19a3c-b5e9-473e-af16-cbef662bcff7] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:45:09.626810 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-6b498bd5-baa7-4c32-93b2-9eb29adfe94e tempest-VolumesSnapshotTestJSON-1359047564 tempest-VolumesSnapshotTestJSON-1359047564-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:45:09.627386 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-6b498bd5-baa7-4c32-93b2-9eb29adfe94e tempest-VolumesSnapshotTestJSON-1359047564 tempest-VolumesSnapshotTestJSON-1359047564-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:45:09.628295 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-6b498bd5-baa7-4c32-93b2-9eb29adfe94e tempest-VolumesSnapshotTestJSON-1359047564 tempest-VolumesSnapshotTestJSON-1359047564-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:45:09.628958 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-6b498bd5-baa7-4c32-93b2-9eb29adfe94e tempest-VolumesSnapshotTestJSON-1359047564 tempest-VolumesSnapshotTestJSON-1359047564-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:45:09.784869 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-26ea7f03-df51-4fe5-8ad3-fe8eeb484c67 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:45:09.793721 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-26ea7f03-df51-4fe5-8ad3-fe8eeb484c67 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:45:09.795245 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-26ea7f03-df51-4fe5-8ad3-fe8eeb484c67 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:45:09.796434 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-26ea7f03-df51-4fe5-8ad3-fe8eeb484c67 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] 10.222.0.42 "GET /compute/v2.1/servers/ce3b66f8-03e9-4d5f-8c40-d1a887b12304" status: 200 len: 1721 microversion: 2.20 time: 0.229018 Jun 06 10:45:09.797166 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 376/771] 10.222.0.42 () {60 vars in 1276 bytes} [Mon Jun 6 10:45:09 2022] GET /compute/v2.1/servers/ce3b66f8-03e9-4d5f-8c40-d1a887b12304 => generated 1721 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 10:45:09.816726 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-6b498bd5-baa7-4c32-93b2-9eb29adfe94e tempest-VolumesSnapshotTestJSON-1359047564 tempest-VolumesSnapshotTestJSON-1359047564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d02effcaa64a2580cdd1613e7ff1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd93c9242f08447aaa597423812d5904d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:45:09.824807 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-6b498bd5-baa7-4c32-93b2-9eb29adfe94e tempest-VolumesSnapshotTestJSON-1359047564 tempest-VolumesSnapshotTestJSON-1359047564-project] 10.222.0.42 "GET /compute/v2.1/servers/bdf19a3c-b5e9-473e-af16-cbef662bcff7" status: 200 len: 1505 microversion: 2.1 time: 0.210655 Jun 06 10:45:09.825384 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 396/772] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:45:09 2022] GET /compute/v2.1/servers/bdf19a3c-b5e9-473e-af16-cbef662bcff7 => generated 1505 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 10:45:10.817815 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-c56d4eb8-0507-4110-bb13-4af64204d686 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:45:10.818680 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-c56d4eb8-0507-4110-bb13-4af64204d686 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] [instance: ce3b66f8-03e9-4d5f-8c40-d1a887b12304] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:45:10.825651 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-c56d4eb8-0507-4110-bb13-4af64204d686 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:45:10.826214 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-c56d4eb8-0507-4110-bb13-4af64204d686 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:45:10.827438 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-c56d4eb8-0507-4110-bb13-4af64204d686 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:45:10.827966 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-c56d4eb8-0507-4110-bb13-4af64204d686 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:45:11.034129 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-c56d4eb8-0507-4110-bb13-4af64204d686 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:45:11.045886 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-c56d4eb8-0507-4110-bb13-4af64204d686 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:45:11.048430 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-c56d4eb8-0507-4110-bb13-4af64204d686 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:45:11.050000 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-c56d4eb8-0507-4110-bb13-4af64204d686 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] 10.222.0.42 "GET /compute/v2.1/servers/ce3b66f8-03e9-4d5f-8c40-d1a887b12304" status: 200 len: 1721 microversion: 2.20 time: 0.236238 Jun 06 10:45:11.050672 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 377/773] 10.222.0.42 () {60 vars in 1276 bytes} [Mon Jun 6 10:45:10 2022] GET /compute/v2.1/servers/ce3b66f8-03e9-4d5f-8c40-d1a887b12304 => generated 1721 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 10:45:12.073955 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-c965f199-2c68-4548-81d7-21f5ca55fa78 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:45:12.075300 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-c965f199-2c68-4548-81d7-21f5ca55fa78 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] [instance: ce3b66f8-03e9-4d5f-8c40-d1a887b12304] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:45:12.095555 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-c965f199-2c68-4548-81d7-21f5ca55fa78 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:45:12.095953 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-c965f199-2c68-4548-81d7-21f5ca55fa78 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:45:12.104646 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-c965f199-2c68-4548-81d7-21f5ca55fa78 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:45:12.106093 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-c965f199-2c68-4548-81d7-21f5ca55fa78 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:45:12.208464 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-c965f199-2c68-4548-81d7-21f5ca55fa78 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:45:12.218362 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-c965f199-2c68-4548-81d7-21f5ca55fa78 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:45:12.220153 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-c965f199-2c68-4548-81d7-21f5ca55fa78 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea1482ba53554f71865cea46ffbac23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4905170c438f456182ba201316a64029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:45:12.225075 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-c965f199-2c68-4548-81d7-21f5ca55fa78 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] 10.222.0.42 "GET /compute/v2.1/servers/ce3b66f8-03e9-4d5f-8c40-d1a887b12304" status: 200 len: 1653 microversion: 2.20 time: 0.159187 Jun 06 10:45:12.225754 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 397/774] 10.222.0.42 () {60 vars in 1276 bytes} [Mon Jun 6 10:45:12 2022] GET /compute/v2.1/servers/ce3b66f8-03e9-4d5f-8c40-d1a887b12304 => generated 1653 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 10:45:12.439190 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [req-f169fa67-3609-47ee-80d4-edd0c11a0aa8 req-b0685ed1-f603-426c-9fe3-dfbe446dc079 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce3b66f8-03e9-4d5f-8c40-d1a887b12304", "name": "network-vif-deleted", "tag": "ff3196f2-cd2c-4cef-8ac8-2d796e5a93a2"}]} {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 10:45:12.457750 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [req-f169fa67-3609-47ee-80d4-edd0c11a0aa8 req-b0685ed1-f603-426c-9fe3-dfbe446dc079 service nova] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:45:12.458534 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [req-f169fa67-3609-47ee-80d4-edd0c11a0aa8 req-b0685ed1-f603-426c-9fe3-dfbe446dc079 service nova] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:45:12.488732 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.compute.server_external_events [req-f169fa67-3609-47ee-80d4-edd0c11a0aa8 req-b0685ed1-f603-426c-9fe3-dfbe446dc079 service nova] Creating event network-vif-deleted:ff3196f2-cd2c-4cef-8ac8-2d796e5a93a2 for instance ce3b66f8-03e9-4d5f-8c40-d1a887b12304 on hv-cinder-84482 Jun 06 10:45:12.496525 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [req-f169fa67-3609-47ee-80d4-edd0c11a0aa8 req-b0685ed1-f603-426c-9fe3-dfbe446dc079 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061539 Jun 06 10:45:12.500140 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 378/775] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Jun 6 10:45:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 10:45:13.246000 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-9d331c2e-dbca-4bc5-bba2-528b00709b49 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:45:13.247381 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-9d331c2e-dbca-4bc5-bba2-528b00709b49 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] [instance: ce3b66f8-03e9-4d5f-8c40-d1a887b12304] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:45:13.255389 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-9d331c2e-dbca-4bc5-bba2-528b00709b49 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:45:13.256131 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-9d331c2e-dbca-4bc5-bba2-528b00709b49 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:45:13.257784 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-9d331c2e-dbca-4bc5-bba2-528b00709b49 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:45:13.258408 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-9d331c2e-dbca-4bc5-bba2-528b00709b49 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:45:13.274262 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.wsgi [None req-9d331c2e-dbca-4bc5-bba2-528b00709b49 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] HTTP exception thrown: Instance ce3b66f8-03e9-4d5f-8c40-d1a887b12304 could not be found. Jun 06 10:45:13.275958 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-9d331c2e-dbca-4bc5-bba2-528b00709b49 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Request method failure captured: Jun 06 10:45:13.275958 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: request: GET /compute/v2.1/servers/ce3b66f8-03e9-4d5f-8c40-d1a887b12304 HTTP/1.1 Jun 06 10:45:13.275958 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: Accept: application/json Jun 06 10:45:13.275958 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: Accept-Encoding: identity Jun 06 10:45:13.275958 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: Connection: close Jun 06 10:45:13.275958 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: Content-Length: 0 Jun 06 10:45:13.275958 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: Content-Type: application/json Jun 06 10:45:13.275958 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: Host: 10.222.0.42 Jun 06 10:45:13.275958 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: Openstack-System-Scope: None Jun 06 10:45:13.275958 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: User-Agent: python-urllib3/1.26.9 Jun 06 10:45:13.275958 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Auth-Token: gAAAAABindkhk5HbPnki7y1mOF6QUbJfXveFJ_2Wi9Hiz8dbxNdA9mGyY-H1VvWvTiOq5i5SKl6hrS6-TjUJXxUfQ_bK7qtIQnMt1h20Q32dUKhA145SHE6n7VRD60I14diW4E6VB9ewqHQrPJl1un6U-mxcj9EU1AW2pM58-0NCiMNK7S6xGq0 Jun 06 10:45:13.275958 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Domain-Id: None Jun 06 10:45:13.275958 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Domain-Name: None Jun 06 10:45:13.275958 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Identity-Status: Confirmed Jun 06 10:45:13.275958 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Is-Admin-Project: True Jun 06 10:45:13.275958 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Openstack-Nova-Api-Version: 2.20 Jun 06 10:45:13.275958 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Project-Domain-Id: default Jun 06 10:45:13.275958 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Project-Domain-Name: Default Jun 06 10:45:13.275958 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Project-Id: 4905170c438f456182ba201316a64029 Jun 06 10:45:13.275958 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1675012870 Jun 06 10:45:13.275958 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Role: member,reader Jun 06 10:45:13.275958 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Roles: member,reader Jun 06 10:45:13.278052 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/4905170c438f456182ba201316a64029"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4905170c438f456182ba201316a64029"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4905170c438f456182ba201316a64029"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_4905170c438f456182ba201316a64029", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Jun 06 10:45:13.278052 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1675012870 Jun 06 10:45:13.278052 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Tenant-Id: 4905170c438f456182ba201316a64029 Jun 06 10:45:13.278052 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1675012870 Jun 06 10:45:13.278052 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-User: tempest-AttachVolumeShelveTestJSON-1675012870-project Jun 06 10:45:13.278052 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-User-Domain-Id: default Jun 06 10:45:13.278052 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-User-Domain-Name: Default Jun 06 10:45:13.278052 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-User-Id: ea1482ba53554f71865cea46ffbac23c Jun 06 10:45:13.278052 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1675012870-project Jun 06 10:45:13.278052 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: method: > Jun 06 10:45:13.278052 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: exception: Instance ce3b66f8-03e9-4d5f-8c40-d1a887b12304 could not be found. Jun 06 10:45:13.278052 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: action_args: {'id': 'ce3b66f8-03e9-4d5f-8c40-d1a887b12304'} Jun 06 10:45:13.279293 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 10:45:13.279293 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 10:45:13.279293 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 06 10:45:13.279293 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 06 10:45:13.279293 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 06 10:45:13.279293 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 06 10:45:13.279293 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 06 10:45:13.279293 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 06 10:45:13.279293 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 06 10:45:13.279293 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 06 10:45:13.279293 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ce3b66f8-03e9-4d5f-8c40-d1a887b12304 could not be found. Jun 06 10:45:13.279293 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Jun 06 10:45:13.279293 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 10:45:13.279293 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Jun 06 10:45:13.279293 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 10:45:13.279293 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 10:45:13.279293 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 10:45:13.279293 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 10:45:13.279293 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 10:45:13.279293 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 10:45:13.280797 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 10:45:13.280797 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 06 10:45:13.280797 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 06 10:45:13.280797 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 06 10:45:13.280797 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 06 10:45:13.280797 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 06 10:45:13.280797 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 06 10:45:13.280797 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ce3b66f8-03e9-4d5f-8c40-d1a887b12304 could not be found. Jun 06 10:45:13.280797 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Jun 06 10:45:13.280797 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 10:45:13.280797 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Jun 06 10:45:13.280797 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 10:45:13.280797 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 10:45:13.280797 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 10:45:13.280797 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 10:45:13.280797 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 10:45:13.280797 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ce3b66f8-03e9-4d5f-8c40-d1a887b12304 could not be found. Jun 06 10:45:13.280797 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Jun 06 10:45:13.282093 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-9d331c2e-dbca-4bc5-bba2-528b00709b49 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Returning 404 to user: Instance ce3b66f8-03e9-4d5f-8c40-d1a887b12304 could not be found. {{(pid=129349) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 10:45:13.282093 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-9d331c2e-dbca-4bc5-bba2-528b00709b49 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] 10.222.0.42 "GET /compute/v2.1/servers/ce3b66f8-03e9-4d5f-8c40-d1a887b12304" status: 404 len: 111 microversion: 2.20 time: 0.037225 Jun 06 10:45:13.282093 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 398/776] 10.222.0.42 () {60 vars in 1276 bytes} [Mon Jun 6 10:45:13 2022] GET /compute/v2.1/servers/ce3b66f8-03e9-4d5f-8c40-d1a887b12304 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 06 10:45:13.287190 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-5a7634e5-8c4a-438a-b1a1-f3ee9c6461ef tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Calling method '.version_select at 0x7f8fd8066ee0>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:45:13.311431 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-5a7634e5-8c4a-438a-b1a1-f3ee9c6461ef tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-991877977" status: 204 len: 0 microversion: 2.20 time: 0.028413 Jun 06 10:45:13.312515 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 379/777] 10.222.0.42 () {60 vars in 1258 bytes} [Mon Jun 6 10:45:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-991877977 => generated 0 bytes in 30 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jun 06 10:45:15.208760 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-9d866f5e-7419-4998-97a2-f933424daee7 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:45:15.209255 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-9d866f5e-7419-4998-97a2-f933424daee7 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] [instance: ce3b66f8-03e9-4d5f-8c40-d1a887b12304] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:45:15.215885 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-9d866f5e-7419-4998-97a2-f933424daee7 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:45:15.216331 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-9d866f5e-7419-4998-97a2-f933424daee7 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:45:15.217094 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-9d866f5e-7419-4998-97a2-f933424daee7 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:45:15.217526 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-9d866f5e-7419-4998-97a2-f933424daee7 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:45:15.230950 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.wsgi [None req-9d866f5e-7419-4998-97a2-f933424daee7 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] HTTP exception thrown: Instance ce3b66f8-03e9-4d5f-8c40-d1a887b12304 could not be found. Jun 06 10:45:15.232522 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-9d866f5e-7419-4998-97a2-f933424daee7 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Request method failure captured: Jun 06 10:45:15.232522 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: request: DELETE /compute/v2.1/servers/ce3b66f8-03e9-4d5f-8c40-d1a887b12304 HTTP/1.1 Jun 06 10:45:15.232522 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: Accept: application/json Jun 06 10:45:15.232522 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: Accept-Encoding: identity Jun 06 10:45:15.232522 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: Connection: close Jun 06 10:45:15.232522 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: Content-Length: 0 Jun 06 10:45:15.232522 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: Content-Type: application/json Jun 06 10:45:15.232522 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: Host: 10.222.0.42 Jun 06 10:45:15.232522 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: Openstack-System-Scope: None Jun 06 10:45:15.232522 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: User-Agent: python-urllib3/1.26.9 Jun 06 10:45:15.232522 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Auth-Token: gAAAAABindkhk5HbPnki7y1mOF6QUbJfXveFJ_2Wi9Hiz8dbxNdA9mGyY-H1VvWvTiOq5i5SKl6hrS6-TjUJXxUfQ_bK7qtIQnMt1h20Q32dUKhA145SHE6n7VRD60I14diW4E6VB9ewqHQrPJl1un6U-mxcj9EU1AW2pM58-0NCiMNK7S6xGq0 Jun 06 10:45:15.232522 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Domain-Id: None Jun 06 10:45:15.232522 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Domain-Name: None Jun 06 10:45:15.232522 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Identity-Status: Confirmed Jun 06 10:45:15.232522 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Is-Admin-Project: True Jun 06 10:45:15.232522 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Openstack-Nova-Api-Version: 2.20 Jun 06 10:45:15.232522 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Project-Domain-Id: default Jun 06 10:45:15.232522 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Project-Domain-Name: Default Jun 06 10:45:15.232522 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Project-Id: 4905170c438f456182ba201316a64029 Jun 06 10:45:15.232522 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1675012870 Jun 06 10:45:15.232522 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Role: member,reader Jun 06 10:45:15.232522 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Roles: member,reader Jun 06 10:45:15.234303 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/4905170c438f456182ba201316a64029"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4905170c438f456182ba201316a64029"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4905170c438f456182ba201316a64029"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_4905170c438f456182ba201316a64029", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Jun 06 10:45:15.234303 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1675012870 Jun 06 10:45:15.234303 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Tenant-Id: 4905170c438f456182ba201316a64029 Jun 06 10:45:15.234303 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1675012870 Jun 06 10:45:15.234303 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-User: tempest-AttachVolumeShelveTestJSON-1675012870-project Jun 06 10:45:15.234303 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-User-Domain-Id: default Jun 06 10:45:15.234303 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-User-Domain-Name: Default Jun 06 10:45:15.234303 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-User-Id: ea1482ba53554f71865cea46ffbac23c Jun 06 10:45:15.234303 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1675012870-project Jun 06 10:45:15.234303 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: method: > Jun 06 10:45:15.234303 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: exception: Instance ce3b66f8-03e9-4d5f-8c40-d1a887b12304 could not be found. Jun 06 10:45:15.234303 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: action_args: {'id': 'ce3b66f8-03e9-4d5f-8c40-d1a887b12304'} Jun 06 10:45:15.235284 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 10:45:15.235284 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 10:45:15.235284 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 06 10:45:15.235284 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 06 10:45:15.235284 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 06 10:45:15.235284 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 06 10:45:15.235284 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 06 10:45:15.235284 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 06 10:45:15.235284 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 06 10:45:15.235284 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 06 10:45:15.235284 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ce3b66f8-03e9-4d5f-8c40-d1a887b12304 could not be found. Jun 06 10:45:15.235284 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Jun 06 10:45:15.235284 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 10:45:15.235284 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Jun 06 10:45:15.235284 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 10:45:15.235284 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 10:45:15.235284 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 10:45:15.235284 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 10:45:15.235284 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 10:45:15.235284 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 10:45:15.236569 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 10:45:15.236569 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 06 10:45:15.236569 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 06 10:45:15.236569 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 06 10:45:15.236569 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 06 10:45:15.236569 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 06 10:45:15.236569 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 06 10:45:15.236569 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 06 10:45:15.236569 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 06 10:45:15.236569 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ce3b66f8-03e9-4d5f-8c40-d1a887b12304 could not be found. Jun 06 10:45:15.236569 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Jun 06 10:45:15.236569 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 10:45:15.236569 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Jun 06 10:45:15.236569 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 10:45:15.236569 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 10:45:15.236569 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 10:45:15.236569 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 10:45:15.236569 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 10:45:15.236569 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ce3b66f8-03e9-4d5f-8c40-d1a887b12304 could not be found. Jun 06 10:45:15.236569 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Jun 06 10:45:15.237950 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-9d866f5e-7419-4998-97a2-f933424daee7 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Returning 404 to user: Instance ce3b66f8-03e9-4d5f-8c40-d1a887b12304 could not be found. {{(pid=129349) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 10:45:15.237950 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-9d866f5e-7419-4998-97a2-f933424daee7 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] 10.222.0.42 "DELETE /compute/v2.1/servers/ce3b66f8-03e9-4d5f-8c40-d1a887b12304" status: 404 len: 111 microversion: 2.20 time: 0.028996 Jun 06 10:45:15.237950 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 399/778] 10.222.0.42 () {60 vars in 1279 bytes} [Mon Jun 6 10:45:15 2022] DELETE /compute/v2.1/servers/ce3b66f8-03e9-4d5f-8c40-d1a887b12304 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 06 10:45:15.243352 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-652e2043-5ec8-45a6-bafe-4c897dd7db59 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:45:15.244812 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-652e2043-5ec8-45a6-bafe-4c897dd7db59 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] [instance: ce3b66f8-03e9-4d5f-8c40-d1a887b12304] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:45:15.251292 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-652e2043-5ec8-45a6-bafe-4c897dd7db59 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:45:15.251963 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-652e2043-5ec8-45a6-bafe-4c897dd7db59 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:45:15.252873 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-652e2043-5ec8-45a6-bafe-4c897dd7db59 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:45:15.253384 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-652e2043-5ec8-45a6-bafe-4c897dd7db59 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:45:15.267929 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.wsgi [None req-652e2043-5ec8-45a6-bafe-4c897dd7db59 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] HTTP exception thrown: Instance ce3b66f8-03e9-4d5f-8c40-d1a887b12304 could not be found. Jun 06 10:45:15.269562 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-652e2043-5ec8-45a6-bafe-4c897dd7db59 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Request method failure captured: Jun 06 10:45:15.269562 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: request: GET /compute/v2.1/servers/ce3b66f8-03e9-4d5f-8c40-d1a887b12304 HTTP/1.1 Jun 06 10:45:15.269562 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: Accept: application/json Jun 06 10:45:15.269562 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: Accept-Encoding: identity Jun 06 10:45:15.269562 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: Connection: close Jun 06 10:45:15.269562 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: Content-Length: 0 Jun 06 10:45:15.269562 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: Content-Type: application/json Jun 06 10:45:15.269562 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: Host: 10.222.0.42 Jun 06 10:45:15.269562 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: Openstack-System-Scope: None Jun 06 10:45:15.269562 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: User-Agent: python-urllib3/1.26.9 Jun 06 10:45:15.269562 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Auth-Token: gAAAAABindkhk5HbPnki7y1mOF6QUbJfXveFJ_2Wi9Hiz8dbxNdA9mGyY-H1VvWvTiOq5i5SKl6hrS6-TjUJXxUfQ_bK7qtIQnMt1h20Q32dUKhA145SHE6n7VRD60I14diW4E6VB9ewqHQrPJl1un6U-mxcj9EU1AW2pM58-0NCiMNK7S6xGq0 Jun 06 10:45:15.269562 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Domain-Id: None Jun 06 10:45:15.269562 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Domain-Name: None Jun 06 10:45:15.269562 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Identity-Status: Confirmed Jun 06 10:45:15.269562 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Is-Admin-Project: True Jun 06 10:45:15.269562 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Openstack-Nova-Api-Version: 2.20 Jun 06 10:45:15.269562 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Project-Domain-Id: default Jun 06 10:45:15.269562 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Project-Domain-Name: Default Jun 06 10:45:15.269562 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Project-Id: 4905170c438f456182ba201316a64029 Jun 06 10:45:15.269562 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1675012870 Jun 06 10:45:15.269562 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Role: member,reader Jun 06 10:45:15.269562 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Roles: member,reader Jun 06 10:45:15.271194 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/4905170c438f456182ba201316a64029"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4905170c438f456182ba201316a64029"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4905170c438f456182ba201316a64029"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_4905170c438f456182ba201316a64029", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Jun 06 10:45:15.271194 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1675012870 Jun 06 10:45:15.271194 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Tenant-Id: 4905170c438f456182ba201316a64029 Jun 06 10:45:15.271194 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1675012870 Jun 06 10:45:15.271194 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-User: tempest-AttachVolumeShelveTestJSON-1675012870-project Jun 06 10:45:15.271194 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-User-Domain-Id: default Jun 06 10:45:15.271194 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-User-Domain-Name: Default Jun 06 10:45:15.271194 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-User-Id: ea1482ba53554f71865cea46ffbac23c Jun 06 10:45:15.271194 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1675012870-project Jun 06 10:45:15.271194 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: method: > Jun 06 10:45:15.271194 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: exception: Instance ce3b66f8-03e9-4d5f-8c40-d1a887b12304 could not be found. Jun 06 10:45:15.271194 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: action_args: {'id': 'ce3b66f8-03e9-4d5f-8c40-d1a887b12304'} Jun 06 10:45:15.272112 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 10:45:15.272112 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 10:45:15.272112 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 06 10:45:15.272112 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 06 10:45:15.272112 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 06 10:45:15.272112 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 06 10:45:15.272112 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 06 10:45:15.272112 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 06 10:45:15.272112 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 06 10:45:15.272112 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 06 10:45:15.272112 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ce3b66f8-03e9-4d5f-8c40-d1a887b12304 could not be found. Jun 06 10:45:15.272112 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi Jun 06 10:45:15.272112 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 10:45:15.272112 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi Jun 06 10:45:15.272112 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 10:45:15.272112 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 10:45:15.272112 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 10:45:15.272112 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 10:45:15.272112 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 10:45:15.272112 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 10:45:15.273545 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 10:45:15.273545 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 06 10:45:15.273545 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 06 10:45:15.273545 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 06 10:45:15.273545 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 06 10:45:15.273545 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 06 10:45:15.273545 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 06 10:45:15.273545 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ce3b66f8-03e9-4d5f-8c40-d1a887b12304 could not be found. Jun 06 10:45:15.273545 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi Jun 06 10:45:15.273545 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 10:45:15.273545 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi Jun 06 10:45:15.273545 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 10:45:15.273545 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 10:45:15.273545 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 10:45:15.273545 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 10:45:15.273545 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 10:45:15.273545 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ce3b66f8-03e9-4d5f-8c40-d1a887b12304 could not be found. Jun 06 10:45:15.273545 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi Jun 06 10:45:15.275058 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-652e2043-5ec8-45a6-bafe-4c897dd7db59 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Returning 404 to user: Instance ce3b66f8-03e9-4d5f-8c40-d1a887b12304 could not be found. {{(pid=129350) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 10:45:15.275058 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-652e2043-5ec8-45a6-bafe-4c897dd7db59 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] 10.222.0.42 "GET /compute/v2.1/servers/ce3b66f8-03e9-4d5f-8c40-d1a887b12304" status: 404 len: 111 microversion: 2.20 time: 0.032642 Jun 06 10:45:15.275058 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 380/779] 10.222.0.42 () {60 vars in 1276 bytes} [Mon Jun 6 10:45:15 2022] GET /compute/v2.1/servers/ce3b66f8-03e9-4d5f-8c40-d1a887b12304 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 06 10:45:16.412604 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-1aae040d-65b7-488c-bdd7-9ebeb0ba8c09 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:45:16.413104 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-1aae040d-65b7-488c-bdd7-9ebeb0ba8c09 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] [instance: 5a0a79a6-8e61-477e-8269-730dfb6d04a6] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:45:16.419694 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-1aae040d-65b7-488c-bdd7-9ebeb0ba8c09 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:45:16.420171 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-1aae040d-65b7-488c-bdd7-9ebeb0ba8c09 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:45:16.420963 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-1aae040d-65b7-488c-bdd7-9ebeb0ba8c09 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:45:16.421441 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-1aae040d-65b7-488c-bdd7-9ebeb0ba8c09 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:45:16.434717 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.wsgi [None req-1aae040d-65b7-488c-bdd7-9ebeb0ba8c09 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] HTTP exception thrown: Instance 5a0a79a6-8e61-477e-8269-730dfb6d04a6 could not be found. Jun 06 10:45:16.436281 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-1aae040d-65b7-488c-bdd7-9ebeb0ba8c09 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Request method failure captured: Jun 06 10:45:16.436281 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: request: DELETE /compute/v2.1/servers/5a0a79a6-8e61-477e-8269-730dfb6d04a6 HTTP/1.1 Jun 06 10:45:16.436281 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: Accept: application/json Jun 06 10:45:16.436281 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: Accept-Encoding: identity Jun 06 10:45:16.436281 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: Connection: close Jun 06 10:45:16.436281 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: Content-Length: 0 Jun 06 10:45:16.436281 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: Content-Type: application/json Jun 06 10:45:16.436281 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: Host: 10.222.0.42 Jun 06 10:45:16.436281 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: Openstack-System-Scope: None Jun 06 10:45:16.436281 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: User-Agent: python-urllib3/1.26.9 Jun 06 10:45:16.436281 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Auth-Token: gAAAAABindkhk5HbPnki7y1mOF6QUbJfXveFJ_2Wi9Hiz8dbxNdA9mGyY-H1VvWvTiOq5i5SKl6hrS6-TjUJXxUfQ_bK7qtIQnMt1h20Q32dUKhA145SHE6n7VRD60I14diW4E6VB9ewqHQrPJl1un6U-mxcj9EU1AW2pM58-0NCiMNK7S6xGq0 Jun 06 10:45:16.436281 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Domain-Id: None Jun 06 10:45:16.436281 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Domain-Name: None Jun 06 10:45:16.436281 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Identity-Status: Confirmed Jun 06 10:45:16.436281 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Is-Admin-Project: True Jun 06 10:45:16.436281 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Openstack-Nova-Api-Version: 2.20 Jun 06 10:45:16.436281 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Project-Domain-Id: default Jun 06 10:45:16.436281 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Project-Domain-Name: Default Jun 06 10:45:16.436281 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Project-Id: 4905170c438f456182ba201316a64029 Jun 06 10:45:16.436281 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1675012870 Jun 06 10:45:16.436281 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Role: member,reader Jun 06 10:45:16.436281 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Roles: member,reader Jun 06 10:45:16.437881 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/4905170c438f456182ba201316a64029"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4905170c438f456182ba201316a64029"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4905170c438f456182ba201316a64029"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_4905170c438f456182ba201316a64029", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Jun 06 10:45:16.437881 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1675012870 Jun 06 10:45:16.437881 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Tenant-Id: 4905170c438f456182ba201316a64029 Jun 06 10:45:16.437881 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1675012870 Jun 06 10:45:16.437881 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-User: tempest-AttachVolumeShelveTestJSON-1675012870-project Jun 06 10:45:16.437881 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-User-Domain-Id: default Jun 06 10:45:16.437881 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-User-Domain-Name: Default Jun 06 10:45:16.437881 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-User-Id: ea1482ba53554f71865cea46ffbac23c Jun 06 10:45:16.437881 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1675012870-project Jun 06 10:45:16.437881 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: method: > Jun 06 10:45:16.437881 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: exception: Instance 5a0a79a6-8e61-477e-8269-730dfb6d04a6 could not be found. Jun 06 10:45:16.437881 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: action_args: {'id': '5a0a79a6-8e61-477e-8269-730dfb6d04a6'} Jun 06 10:45:16.438679 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 10:45:16.438679 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 10:45:16.438679 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 06 10:45:16.438679 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 06 10:45:16.438679 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 06 10:45:16.438679 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 06 10:45:16.438679 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 06 10:45:16.438679 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 06 10:45:16.438679 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 06 10:45:16.438679 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 06 10:45:16.438679 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5a0a79a6-8e61-477e-8269-730dfb6d04a6 could not be found. Jun 06 10:45:16.438679 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Jun 06 10:45:16.438679 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 10:45:16.438679 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Jun 06 10:45:16.438679 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 10:45:16.438679 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 10:45:16.438679 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 10:45:16.438679 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 10:45:16.438679 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 10:45:16.438679 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 10:45:16.440311 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 10:45:16.440311 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 06 10:45:16.440311 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 06 10:45:16.440311 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 06 10:45:16.440311 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 06 10:45:16.440311 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 06 10:45:16.440311 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 06 10:45:16.440311 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 06 10:45:16.440311 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 06 10:45:16.440311 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5a0a79a6-8e61-477e-8269-730dfb6d04a6 could not be found. Jun 06 10:45:16.440311 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Jun 06 10:45:16.440311 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 10:45:16.440311 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Jun 06 10:45:16.440311 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 10:45:16.440311 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 10:45:16.440311 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 10:45:16.440311 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 10:45:16.440311 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 10:45:16.440311 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5a0a79a6-8e61-477e-8269-730dfb6d04a6 could not be found. Jun 06 10:45:16.440311 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Jun 06 10:45:16.441750 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-1aae040d-65b7-488c-bdd7-9ebeb0ba8c09 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Returning 404 to user: Instance 5a0a79a6-8e61-477e-8269-730dfb6d04a6 could not be found. {{(pid=129349) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 10:45:16.441750 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-1aae040d-65b7-488c-bdd7-9ebeb0ba8c09 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] 10.222.0.42 "DELETE /compute/v2.1/servers/5a0a79a6-8e61-477e-8269-730dfb6d04a6" status: 404 len: 111 microversion: 2.20 time: 0.028923 Jun 06 10:45:16.441750 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 400/780] 10.222.0.42 () {60 vars in 1279 bytes} [Mon Jun 6 10:45:16 2022] DELETE /compute/v2.1/servers/5a0a79a6-8e61-477e-8269-730dfb6d04a6 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 06 10:45:16.446867 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-417a715d-9d59-4a5e-b5a9-74a87b747328 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:45:16.447477 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-417a715d-9d59-4a5e-b5a9-74a87b747328 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] [instance: 5a0a79a6-8e61-477e-8269-730dfb6d04a6] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:45:16.454323 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-417a715d-9d59-4a5e-b5a9-74a87b747328 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:45:16.454760 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-417a715d-9d59-4a5e-b5a9-74a87b747328 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:45:16.455530 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-417a715d-9d59-4a5e-b5a9-74a87b747328 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:45:16.456090 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-417a715d-9d59-4a5e-b5a9-74a87b747328 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:45:16.470334 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.wsgi [None req-417a715d-9d59-4a5e-b5a9-74a87b747328 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] HTTP exception thrown: Instance 5a0a79a6-8e61-477e-8269-730dfb6d04a6 could not be found. Jun 06 10:45:16.471920 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-417a715d-9d59-4a5e-b5a9-74a87b747328 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Request method failure captured: Jun 06 10:45:16.471920 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: request: GET /compute/v2.1/servers/5a0a79a6-8e61-477e-8269-730dfb6d04a6 HTTP/1.1 Jun 06 10:45:16.471920 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: Accept: application/json Jun 06 10:45:16.471920 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: Accept-Encoding: identity Jun 06 10:45:16.471920 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: Connection: close Jun 06 10:45:16.471920 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: Content-Length: 0 Jun 06 10:45:16.471920 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: Content-Type: application/json Jun 06 10:45:16.471920 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: Host: 10.222.0.42 Jun 06 10:45:16.471920 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: Openstack-System-Scope: None Jun 06 10:45:16.471920 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: User-Agent: python-urllib3/1.26.9 Jun 06 10:45:16.471920 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Auth-Token: gAAAAABindkhk5HbPnki7y1mOF6QUbJfXveFJ_2Wi9Hiz8dbxNdA9mGyY-H1VvWvTiOq5i5SKl6hrS6-TjUJXxUfQ_bK7qtIQnMt1h20Q32dUKhA145SHE6n7VRD60I14diW4E6VB9ewqHQrPJl1un6U-mxcj9EU1AW2pM58-0NCiMNK7S6xGq0 Jun 06 10:45:16.471920 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Domain-Id: None Jun 06 10:45:16.471920 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Domain-Name: None Jun 06 10:45:16.471920 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Identity-Status: Confirmed Jun 06 10:45:16.471920 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Is-Admin-Project: True Jun 06 10:45:16.471920 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Openstack-Nova-Api-Version: 2.20 Jun 06 10:45:16.471920 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Project-Domain-Id: default Jun 06 10:45:16.471920 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Project-Domain-Name: Default Jun 06 10:45:16.471920 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Project-Id: 4905170c438f456182ba201316a64029 Jun 06 10:45:16.471920 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1675012870 Jun 06 10:45:16.471920 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Role: member,reader Jun 06 10:45:16.471920 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Roles: member,reader Jun 06 10:45:16.473560 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/4905170c438f456182ba201316a64029"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4905170c438f456182ba201316a64029"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4905170c438f456182ba201316a64029"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_4905170c438f456182ba201316a64029", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Jun 06 10:45:16.473560 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1675012870 Jun 06 10:45:16.473560 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Tenant-Id: 4905170c438f456182ba201316a64029 Jun 06 10:45:16.473560 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1675012870 Jun 06 10:45:16.473560 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-User: tempest-AttachVolumeShelveTestJSON-1675012870-project Jun 06 10:45:16.473560 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-User-Domain-Id: default Jun 06 10:45:16.473560 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-User-Domain-Name: Default Jun 06 10:45:16.473560 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-User-Id: ea1482ba53554f71865cea46ffbac23c Jun 06 10:45:16.473560 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1675012870-project Jun 06 10:45:16.473560 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: method: > Jun 06 10:45:16.473560 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: exception: Instance 5a0a79a6-8e61-477e-8269-730dfb6d04a6 could not be found. Jun 06 10:45:16.473560 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: action_args: {'id': '5a0a79a6-8e61-477e-8269-730dfb6d04a6'} Jun 06 10:45:16.474508 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 10:45:16.474508 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 10:45:16.474508 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 06 10:45:16.474508 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 06 10:45:16.474508 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 06 10:45:16.474508 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 06 10:45:16.474508 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 06 10:45:16.474508 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 06 10:45:16.474508 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 06 10:45:16.474508 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 06 10:45:16.474508 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5a0a79a6-8e61-477e-8269-730dfb6d04a6 could not be found. Jun 06 10:45:16.474508 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi Jun 06 10:45:16.474508 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 10:45:16.474508 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi Jun 06 10:45:16.474508 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 10:45:16.474508 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 10:45:16.474508 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 10:45:16.474508 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 10:45:16.474508 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 10:45:16.474508 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 10:45:16.475970 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 10:45:16.475970 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 06 10:45:16.475970 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 06 10:45:16.475970 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 06 10:45:16.475970 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 06 10:45:16.475970 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 06 10:45:16.475970 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 06 10:45:16.475970 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5a0a79a6-8e61-477e-8269-730dfb6d04a6 could not be found. Jun 06 10:45:16.475970 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi Jun 06 10:45:16.475970 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 10:45:16.475970 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi Jun 06 10:45:16.475970 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 10:45:16.475970 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 10:45:16.475970 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 10:45:16.475970 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 10:45:16.475970 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 10:45:16.475970 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5a0a79a6-8e61-477e-8269-730dfb6d04a6 could not be found. Jun 06 10:45:16.475970 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi Jun 06 10:45:16.477268 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-417a715d-9d59-4a5e-b5a9-74a87b747328 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] Returning 404 to user: Instance 5a0a79a6-8e61-477e-8269-730dfb6d04a6 could not be found. {{(pid=129350) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 10:45:16.477268 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-417a715d-9d59-4a5e-b5a9-74a87b747328 tempest-AttachVolumeShelveTestJSON-1675012870 tempest-AttachVolumeShelveTestJSON-1675012870-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0a79a6-8e61-477e-8269-730dfb6d04a6" status: 404 len: 111 microversion: 2.20 time: 0.031015 Jun 06 10:45:16.477268 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 381/781] 10.222.0.42 () {60 vars in 1276 bytes} [Mon Jun 6 10:45:16 2022] GET /compute/v2.1/servers/5a0a79a6-8e61-477e-8269-730dfb6d04a6 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jun 06 10:45:25.029506 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-9574734d-a1a9-4a96-b0fa-ad8012c82a71 tempest-VolumesSnapshotTestJSON-1359047564 tempest-VolumesSnapshotTestJSON-1359047564-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c9bc4640-e6ee-42d9-8140-d2643f526489", "device": "/dev/sdb"}} {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 10:45:25.031122 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-9574734d-a1a9-4a96-b0fa-ad8012c82a71 tempest-VolumesSnapshotTestJSON-1359047564 tempest-VolumesSnapshotTestJSON-1359047564-project] [instance: bdf19a3c-b5e9-473e-af16-cbef662bcff7] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:45:25.037309 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-9574734d-a1a9-4a96-b0fa-ad8012c82a71 tempest-VolumesSnapshotTestJSON-1359047564 tempest-VolumesSnapshotTestJSON-1359047564-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:45:25.037753 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-9574734d-a1a9-4a96-b0fa-ad8012c82a71 tempest-VolumesSnapshotTestJSON-1359047564 tempest-VolumesSnapshotTestJSON-1359047564-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:45:25.038506 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-9574734d-a1a9-4a96-b0fa-ad8012c82a71 tempest-VolumesSnapshotTestJSON-1359047564 tempest-VolumesSnapshotTestJSON-1359047564-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:45:25.040085 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-9574734d-a1a9-4a96-b0fa-ad8012c82a71 tempest-VolumesSnapshotTestJSON-1359047564 tempest-VolumesSnapshotTestJSON-1359047564-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:45:25.282229 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-9574734d-a1a9-4a96-b0fa-ad8012c82a71 tempest-VolumesSnapshotTestJSON-1359047564 tempest-VolumesSnapshotTestJSON-1359047564-project] 10.222.0.42 "POST /compute/v2.1/servers/bdf19a3c-b5e9-473e-af16-cbef662bcff7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.258976 Jun 06 10:45:25.287359 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 401/782] 10.222.0.42 () {60 vars in 1322 bytes} [Mon Jun 6 10:45:25 2022] POST /compute/v2.1/servers/bdf19a3c-b5e9-473e-af16-cbef662bcff7/os-volume_attachments => generated 194 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 10:45:29.157192 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-b828c61e-9c31-4660-98a8-f09f53c527d4 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:45:29.157745 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-b828c61e-9c31-4660-98a8-f09f53c527d4 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] [instance: 7490171a-7d11-4bb4-ad17-852fdbd2af8b] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:45:29.160246 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG dbcounter [-] [129350] Writing DB stats nova_api:SELECT=50,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=129350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 10:45:29.160898 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG dbcounter [-] [129350] Writing DB stats nova_cell1:SELECT=76 {{(pid=129350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 10:45:29.167522 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-b828c61e-9c31-4660-98a8-f09f53c527d4 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:45:29.168006 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-b828c61e-9c31-4660-98a8-f09f53c527d4 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:45:29.168763 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-b828c61e-9c31-4660-98a8-f09f53c527d4 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:45:29.169190 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-b828c61e-9c31-4660-98a8-f09f53c527d4 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:45:29.193721 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-b828c61e-9c31-4660-98a8-f09f53c527d4 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] 10.222.0.42 "GET /compute/v2.1/servers/7490171a-7d11-4bb4-ad17-852fdbd2af8b/ips" status: 200 len: 150 microversion: 2.1 time: 0.040420 Jun 06 10:45:29.194296 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 382/783] 10.222.0.42 () {58 vars in 1247 bytes} [Mon Jun 6 10:45:29 2022] GET /compute/v2.1/servers/7490171a-7d11-4bb4-ad17-852fdbd2af8b/ips => generated 150 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 10:45:29.206017 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-1204b04b-5320-443b-ab5f-f87a335864e3 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ce183db7-fc9b-4b15-a86a-e931704dc836"}} {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 10:45:29.207298 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-1204b04b-5320-443b-ab5f-f87a335864e3 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] [instance: 7490171a-7d11-4bb4-ad17-852fdbd2af8b] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:45:29.209382 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG dbcounter [-] [129349] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=129349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 10:45:29.215250 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-1204b04b-5320-443b-ab5f-f87a335864e3 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:45:29.215712 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-1204b04b-5320-443b-ab5f-f87a335864e3 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:45:29.216561 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-1204b04b-5320-443b-ab5f-f87a335864e3 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:45:29.216997 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-1204b04b-5320-443b-ab5f-f87a335864e3 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:45:29.221946 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG dbcounter [-] [129349] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=129349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 10:45:29.298032 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.wsgi [None req-1204b04b-5320-443b-ab5f-f87a335864e3 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] HTTP exception thrown: Invalid volume: volume ce183db7-fc9b-4b15-a86a-e931704dc836 is already attached to instances: 3827eb37-6346-4a31-a6e5-25b90628827c Jun 06 10:45:29.299808 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-1204b04b-5320-443b-ab5f-f87a335864e3 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Request method failure captured: Jun 06 10:45:29.299808 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: request: POST /compute/v2.1/servers/7490171a-7d11-4bb4-ad17-852fdbd2af8b/os-volume_attachments HTTP/1.1 Jun 06 10:45:29.299808 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: Accept: application/json Jun 06 10:45:29.299808 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: Accept-Encoding: identity Jun 06 10:45:29.299808 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: Connection: close Jun 06 10:45:29.299808 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: Content-Length: 74 Jun 06 10:45:29.299808 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: Content-Type: application/json Jun 06 10:45:29.299808 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: Host: 10.222.0.42 Jun 06 10:45:29.299808 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: Openstack-System-Scope: None Jun 06 10:45:29.299808 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: User-Agent: python-urllib3/1.26.9 Jun 06 10:45:29.299808 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Auth-Token: gAAAAABindpS5StX_xHu79Eyze6WiReBQv-1XmH_nbXfOmEXKeceOSLZM5qrKAT8lmCw6P5JEWqX6Nq9MOy22mDxxwSXFHT-nuQ59QQYMYHodXP_RU6pUiqpnXRk4PCXE--rTT-t8YJ-1daoywKB7L9jlYu_naOtOmjpMkLKZOiBTDyqPdUS4xY Jun 06 10:45:29.299808 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Domain-Id: None Jun 06 10:45:29.299808 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Domain-Name: None Jun 06 10:45:29.299808 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Identity-Status: Confirmed Jun 06 10:45:29.299808 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Is-Admin-Project: True Jun 06 10:45:29.299808 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Project-Domain-Id: default Jun 06 10:45:29.299808 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Project-Domain-Name: Default Jun 06 10:45:29.299808 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Project-Id: 92244b4ae17d49bebe621e803bd9ae58 Jun 06 10:45:29.299808 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Project-Name: tempest-AttachVolumeNegativeTest-363942965 Jun 06 10:45:29.299808 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Role: member,reader Jun 06 10:45:29.299808 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Roles: member,reader Jun 06 10:45:29.301340 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/92244b4ae17d49bebe621e803bd9ae58"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/92244b4ae17d49bebe621e803bd9ae58"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/92244b4ae17d49bebe621e803bd9ae58"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_92244b4ae17d49bebe621e803bd9ae58", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Jun 06 10:45:29.301340 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Tenant: tempest-AttachVolumeNegativeTest-363942965 Jun 06 10:45:29.301340 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Tenant-Id: 92244b4ae17d49bebe621e803bd9ae58 Jun 06 10:45:29.301340 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-363942965 Jun 06 10:45:29.301340 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-User: tempest-AttachVolumeNegativeTest-363942965-project Jun 06 10:45:29.301340 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-User-Domain-Id: default Jun 06 10:45:29.301340 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-User-Domain-Name: Default Jun 06 10:45:29.301340 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-User-Id: 7ba341ea1ac34874bbfb8b2f713aea1b Jun 06 10:45:29.301340 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-User-Name: tempest-AttachVolumeNegativeTest-363942965-project Jun 06 10:45:29.301340 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: Jun 06 10:45:29.301340 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: {"volumeAttachment": {"volumeId": "ce183db7-fc9b-4b15-a86a-e931704dc836"}} Jun 06 10:45:29.301340 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: method: > Jun 06 10:45:29.302156 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: exception: Invalid volume: volume ce183db7-fc9b-4b15-a86a-e931704dc836 is already attached to instances: 3827eb37-6346-4a31-a6e5-25b90628827c Jun 06 10:45:29.302156 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: action_args: {'server_id': '7490171a-7d11-4bb4-ad17-852fdbd2af8b', 'body': {'volumeAttachment': {'volumeId': 'ce183db7-fc9b-4b15-a86a-e931704dc836'}}} Jun 06 10:45:29.302156 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 10:45:29.302156 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 10:45:29.302156 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 06 10:45:29.302156 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 06 10:45:29.302156 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 06 10:45:29.302156 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 06 10:45:29.302156 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 06 10:45:29.302156 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 06 10:45:29.302156 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jun 06 10:45:29.302156 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jun 06 10:45:29.302156 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jun 06 10:45:29.302156 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jun 06 10:45:29.302156 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume ce183db7-fc9b-4b15-a86a-e931704dc836 is already attached to instances: 3827eb37-6346-4a31-a6e5-25b90628827c Jun 06 10:45:29.302156 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Jun 06 10:45:29.302156 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 10:45:29.302156 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Jun 06 10:45:29.302156 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 10:45:29.303394 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 10:45:29.303394 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 10:45:29.303394 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 10:45:29.303394 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 10:45:29.303394 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 10:45:29.303394 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 10:45:29.303394 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 06 10:45:29.303394 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 06 10:45:29.303394 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 06 10:45:29.303394 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 06 10:45:29.303394 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 06 10:45:29.303394 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 06 10:45:29.303394 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jun 06 10:45:29.303394 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 06 10:45:29.303394 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume ce183db7-fc9b-4b15-a86a-e931704dc836 is already attached to instances: 3827eb37-6346-4a31-a6e5-25b90628827c Jun 06 10:45:29.303394 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Jun 06 10:45:29.303394 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 10:45:29.303394 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Jun 06 10:45:29.303394 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 10:45:29.303394 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 10:45:29.306195 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 10:45:29.306195 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 10:45:29.306195 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 10:45:29.306195 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume ce183db7-fc9b-4b15-a86a-e931704dc836 is already attached to instances: 3827eb37-6346-4a31-a6e5-25b90628827c Jun 06 10:45:29.306195 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Jun 06 10:45:29.306195 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-1204b04b-5320-443b-ab5f-f87a335864e3 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Returning 400 to user: Invalid volume: volume ce183db7-fc9b-4b15-a86a-e931704dc836 is already attached to instances: 3827eb37-6346-4a31-a6e5-25b90628827c {{(pid=129349) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 10:45:29.306195 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-1204b04b-5320-443b-ab5f-f87a335864e3 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] 10.222.0.42 "POST /compute/v2.1/servers/7490171a-7d11-4bb4-ad17-852fdbd2af8b/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.100051 Jun 06 10:45:29.306195 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 402/784] 10.222.0.42 () {60 vars in 1322 bytes} [Mon Jun 6 10:45:29 2022] POST /compute/v2.1/servers/7490171a-7d11-4bb4-ad17-852fdbd2af8b/os-volume_attachments => generated 174 bytes in 101 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 06 10:45:29.309826 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-28cb8cbf-505d-44f3-9428-39d581a67219 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:45:29.310327 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-28cb8cbf-505d-44f3-9428-39d581a67219 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] [instance: 7490171a-7d11-4bb4-ad17-852fdbd2af8b] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:45:29.316528 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-28cb8cbf-505d-44f3-9428-39d581a67219 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:45:29.317078 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-28cb8cbf-505d-44f3-9428-39d581a67219 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:45:29.317845 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-28cb8cbf-505d-44f3-9428-39d581a67219 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:45:29.318288 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-28cb8cbf-505d-44f3-9428-39d581a67219 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:45:29.342926 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-28cb8cbf-505d-44f3-9428-39d581a67219 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] [instance: 7490171a-7d11-4bb4-ad17-852fdbd2af8b] Going to try to terminate instance {{(pid=129350) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 06 10:45:29.427734 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-28cb8cbf-505d-44f3-9428-39d581a67219 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] 10.222.0.42 "DELETE /compute/v2.1/servers/7490171a-7d11-4bb4-ad17-852fdbd2af8b" status: 204 len: 0 microversion: 2.1 time: 0.121118 Jun 06 10:45:29.428710 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 383/785] 10.222.0.42 () {58 vars in 1238 bytes} [Mon Jun 6 10:45:29 2022] DELETE /compute/v2.1/servers/7490171a-7d11-4bb4-ad17-852fdbd2af8b => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 06 10:45:29.437754 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-385f8f79-db23-4602-a2a9-74a6f2214485 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:45:29.438396 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-385f8f79-db23-4602-a2a9-74a6f2214485 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] [instance: 7490171a-7d11-4bb4-ad17-852fdbd2af8b] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:45:29.446148 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-385f8f79-db23-4602-a2a9-74a6f2214485 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:45:29.446814 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-385f8f79-db23-4602-a2a9-74a6f2214485 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:45:29.447648 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-385f8f79-db23-4602-a2a9-74a6f2214485 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:45:29.448087 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-385f8f79-db23-4602-a2a9-74a6f2214485 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:45:29.609324 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-385f8f79-db23-4602-a2a9-74a6f2214485 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ba341ea1ac34874bbfb8b2f713aea1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92244b4ae17d49bebe621e803bd9ae58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:45:29.616757 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-385f8f79-db23-4602-a2a9-74a6f2214485 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] 10.222.0.42 "GET /compute/v2.1/servers/7490171a-7d11-4bb4-ad17-852fdbd2af8b" status: 200 len: 1679 microversion: 2.1 time: 0.183068 Jun 06 10:45:29.617308 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 403/786] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:45:29 2022] GET /compute/v2.1/servers/7490171a-7d11-4bb4-ad17-852fdbd2af8b => generated 1679 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 10:45:30.636740 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-54194d38-2d14-4ae9-8e93-93e6ed36d80d tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:45:30.637736 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-54194d38-2d14-4ae9-8e93-93e6ed36d80d tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] [instance: 7490171a-7d11-4bb4-ad17-852fdbd2af8b] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:45:30.646345 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-54194d38-2d14-4ae9-8e93-93e6ed36d80d tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:45:30.646345 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-54194d38-2d14-4ae9-8e93-93e6ed36d80d tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:45:30.646345 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-54194d38-2d14-4ae9-8e93-93e6ed36d80d tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:45:30.646771 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-54194d38-2d14-4ae9-8e93-93e6ed36d80d tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:45:30.782331 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-54194d38-2d14-4ae9-8e93-93e6ed36d80d tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ba341ea1ac34874bbfb8b2f713aea1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92244b4ae17d49bebe621e803bd9ae58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:45:30.790088 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-54194d38-2d14-4ae9-8e93-93e6ed36d80d tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] 10.222.0.42 "GET /compute/v2.1/servers/7490171a-7d11-4bb4-ad17-852fdbd2af8b" status: 200 len: 1679 microversion: 2.1 time: 0.159172 Jun 06 10:45:30.790788 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 384/787] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:45:30 2022] GET /compute/v2.1/servers/7490171a-7d11-4bb4-ad17-852fdbd2af8b => generated 1679 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:45:31.808129 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-05b27d83-1af6-4ede-a00e-1e71e64165ee tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:45:31.809844 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-05b27d83-1af6-4ede-a00e-1e71e64165ee tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] [instance: 7490171a-7d11-4bb4-ad17-852fdbd2af8b] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:45:31.816312 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-05b27d83-1af6-4ede-a00e-1e71e64165ee tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:45:31.816823 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-05b27d83-1af6-4ede-a00e-1e71e64165ee tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:45:31.817603 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-05b27d83-1af6-4ede-a00e-1e71e64165ee tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:45:31.818061 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-05b27d83-1af6-4ede-a00e-1e71e64165ee tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:45:31.890730 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-05b27d83-1af6-4ede-a00e-1e71e64165ee tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ba341ea1ac34874bbfb8b2f713aea1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92244b4ae17d49bebe621e803bd9ae58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:45:31.899801 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-05b27d83-1af6-4ede-a00e-1e71e64165ee tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] 10.222.0.42 "GET /compute/v2.1/servers/7490171a-7d11-4bb4-ad17-852fdbd2af8b" status: 200 len: 1613 microversion: 2.1 time: 0.096358 Jun 06 10:45:31.910133 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 404/788] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:45:31 2022] GET /compute/v2.1/servers/7490171a-7d11-4bb4-ad17-852fdbd2af8b => generated 1613 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:45:31.946752 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [req-cb76672d-b688-44a3-af1c-a68809cdcb49 req-7314f7f6-af53-4199-8e19-3fa23746e07c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7490171a-7d11-4bb4-ad17-852fdbd2af8b", "name": "network-vif-deleted", "tag": "9608fdc9-f9d6-4de7-84db-028c5280761f"}]} {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 10:45:31.955829 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [req-cb76672d-b688-44a3-af1c-a68809cdcb49 req-7314f7f6-af53-4199-8e19-3fa23746e07c service nova] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:45:31.956296 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [req-cb76672d-b688-44a3-af1c-a68809cdcb49 req-7314f7f6-af53-4199-8e19-3fa23746e07c service nova] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:45:31.968705 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.compute.server_external_events [req-cb76672d-b688-44a3-af1c-a68809cdcb49 req-7314f7f6-af53-4199-8e19-3fa23746e07c service nova] Creating event network-vif-deleted:9608fdc9-f9d6-4de7-84db-028c5280761f for instance 7490171a-7d11-4bb4-ad17-852fdbd2af8b on hv-cinder-84482 Jun 06 10:45:31.974597 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [req-cb76672d-b688-44a3-af1c-a68809cdcb49 req-7314f7f6-af53-4199-8e19-3fa23746e07c service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032396 Jun 06 10:45:31.975228 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 385/789] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Jun 6 10:45:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 10:45:32.917562 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-9eb6fc55-b036-4f69-96bf-83b68d92f652 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:45:32.918223 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-9eb6fc55-b036-4f69-96bf-83b68d92f652 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] [instance: 7490171a-7d11-4bb4-ad17-852fdbd2af8b] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:45:32.932066 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-9eb6fc55-b036-4f69-96bf-83b68d92f652 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:45:32.932690 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-9eb6fc55-b036-4f69-96bf-83b68d92f652 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:45:32.933486 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-9eb6fc55-b036-4f69-96bf-83b68d92f652 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:45:32.933958 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-9eb6fc55-b036-4f69-96bf-83b68d92f652 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:45:32.967839 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-9eb6fc55-b036-4f69-96bf-83b68d92f652 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:45:32.968237 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-9eb6fc55-b036-4f69-96bf-83b68d92f652 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:45:32.968693 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.objects.instance [None req-9eb6fc55-b036-4f69-96bf-83b68d92f652 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lazy-loading 'fault' on Instance uuid 7490171a-7d11-4bb4-ad17-852fdbd2af8b {{(pid=129349) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 06 10:45:33.010029 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-9eb6fc55-b036-4f69-96bf-83b68d92f652 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ba341ea1ac34874bbfb8b2f713aea1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92244b4ae17d49bebe621e803bd9ae58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:45:33.017823 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-9eb6fc55-b036-4f69-96bf-83b68d92f652 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] 10.222.0.42 "GET /compute/v2.1/servers/7490171a-7d11-4bb4-ad17-852fdbd2af8b" status: 200 len: 1330 microversion: 2.1 time: 0.104673 Jun 06 10:45:33.018386 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 405/790] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:45:32 2022] GET /compute/v2.1/servers/7490171a-7d11-4bb4-ad17-852fdbd2af8b => generated 1330 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:45:34.036820 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-abacb50e-a95f-43bc-8aff-8a5a0abc685c tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:45:34.037479 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-abacb50e-a95f-43bc-8aff-8a5a0abc685c tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] [instance: 7490171a-7d11-4bb4-ad17-852fdbd2af8b] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:45:34.043850 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-abacb50e-a95f-43bc-8aff-8a5a0abc685c tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:45:34.044291 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-abacb50e-a95f-43bc-8aff-8a5a0abc685c tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:45:34.045060 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-abacb50e-a95f-43bc-8aff-8a5a0abc685c tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:45:34.045496 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-abacb50e-a95f-43bc-8aff-8a5a0abc685c tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:45:34.077972 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-abacb50e-a95f-43bc-8aff-8a5a0abc685c tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:45:34.078414 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-abacb50e-a95f-43bc-8aff-8a5a0abc685c tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:45:34.078858 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.objects.instance [None req-abacb50e-a95f-43bc-8aff-8a5a0abc685c tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lazy-loading 'fault' on Instance uuid 7490171a-7d11-4bb4-ad17-852fdbd2af8b {{(pid=129350) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 06 10:45:34.123500 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-abacb50e-a95f-43bc-8aff-8a5a0abc685c tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ba341ea1ac34874bbfb8b2f713aea1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92244b4ae17d49bebe621e803bd9ae58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:45:34.131014 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-abacb50e-a95f-43bc-8aff-8a5a0abc685c tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] 10.222.0.42 "GET /compute/v2.1/servers/7490171a-7d11-4bb4-ad17-852fdbd2af8b" status: 200 len: 1330 microversion: 2.1 time: 0.099021 Jun 06 10:45:34.131573 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 386/791] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:45:34 2022] GET /compute/v2.1/servers/7490171a-7d11-4bb4-ad17-852fdbd2af8b => generated 1330 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:45:35.151207 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-ba32abf1-bc57-4567-8950-46101caa0956 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:45:35.151744 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-ba32abf1-bc57-4567-8950-46101caa0956 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] [instance: 7490171a-7d11-4bb4-ad17-852fdbd2af8b] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:45:35.158683 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-ba32abf1-bc57-4567-8950-46101caa0956 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:45:35.159057 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-ba32abf1-bc57-4567-8950-46101caa0956 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:45:35.159869 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-ba32abf1-bc57-4567-8950-46101caa0956 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:45:35.160314 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-ba32abf1-bc57-4567-8950-46101caa0956 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:45:35.174758 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.wsgi [None req-ba32abf1-bc57-4567-8950-46101caa0956 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] HTTP exception thrown: Instance 7490171a-7d11-4bb4-ad17-852fdbd2af8b could not be found. Jun 06 10:45:35.176434 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-ba32abf1-bc57-4567-8950-46101caa0956 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Request method failure captured: Jun 06 10:45:35.176434 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: request: GET /compute/v2.1/servers/7490171a-7d11-4bb4-ad17-852fdbd2af8b HTTP/1.1 Jun 06 10:45:35.176434 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: Accept: application/json Jun 06 10:45:35.176434 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: Accept-Encoding: identity Jun 06 10:45:35.176434 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: Connection: close Jun 06 10:45:35.176434 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: Content-Length: 0 Jun 06 10:45:35.176434 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: Content-Type: application/json Jun 06 10:45:35.176434 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: Host: 10.222.0.42 Jun 06 10:45:35.176434 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: Openstack-System-Scope: None Jun 06 10:45:35.176434 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: User-Agent: python-urllib3/1.26.9 Jun 06 10:45:35.176434 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Auth-Token: gAAAAABindpS5StX_xHu79Eyze6WiReBQv-1XmH_nbXfOmEXKeceOSLZM5qrKAT8lmCw6P5JEWqX6Nq9MOy22mDxxwSXFHT-nuQ59QQYMYHodXP_RU6pUiqpnXRk4PCXE--rTT-t8YJ-1daoywKB7L9jlYu_naOtOmjpMkLKZOiBTDyqPdUS4xY Jun 06 10:45:35.176434 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Domain-Id: None Jun 06 10:45:35.176434 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Domain-Name: None Jun 06 10:45:35.176434 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Identity-Status: Confirmed Jun 06 10:45:35.176434 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Is-Admin-Project: True Jun 06 10:45:35.176434 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Project-Domain-Id: default Jun 06 10:45:35.176434 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Project-Domain-Name: Default Jun 06 10:45:35.176434 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Project-Id: 92244b4ae17d49bebe621e803bd9ae58 Jun 06 10:45:35.176434 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Project-Name: tempest-AttachVolumeNegativeTest-363942965 Jun 06 10:45:35.176434 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Role: member,reader Jun 06 10:45:35.176434 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Roles: member,reader Jun 06 10:45:35.177975 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/92244b4ae17d49bebe621e803bd9ae58"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/92244b4ae17d49bebe621e803bd9ae58"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/92244b4ae17d49bebe621e803bd9ae58"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_92244b4ae17d49bebe621e803bd9ae58", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Jun 06 10:45:35.177975 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Tenant: tempest-AttachVolumeNegativeTest-363942965 Jun 06 10:45:35.177975 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Tenant-Id: 92244b4ae17d49bebe621e803bd9ae58 Jun 06 10:45:35.177975 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-363942965 Jun 06 10:45:35.177975 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-User: tempest-AttachVolumeNegativeTest-363942965-project Jun 06 10:45:35.177975 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-User-Domain-Id: default Jun 06 10:45:35.177975 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-User-Domain-Name: Default Jun 06 10:45:35.177975 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-User-Id: 7ba341ea1ac34874bbfb8b2f713aea1b Jun 06 10:45:35.177975 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-User-Name: tempest-AttachVolumeNegativeTest-363942965-project Jun 06 10:45:35.177975 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: method: > Jun 06 10:45:35.177975 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: exception: Instance 7490171a-7d11-4bb4-ad17-852fdbd2af8b could not be found. Jun 06 10:45:35.177975 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: action_args: {'id': '7490171a-7d11-4bb4-ad17-852fdbd2af8b'} Jun 06 10:45:35.179944 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 10:45:35.179944 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 10:45:35.179944 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 06 10:45:35.179944 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 06 10:45:35.179944 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 06 10:45:35.179944 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 06 10:45:35.179944 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 06 10:45:35.179944 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 06 10:45:35.179944 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 06 10:45:35.179944 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 06 10:45:35.179944 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7490171a-7d11-4bb4-ad17-852fdbd2af8b could not be found. Jun 06 10:45:35.179944 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Jun 06 10:45:35.179944 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 10:45:35.179944 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Jun 06 10:45:35.179944 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 10:45:35.179944 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 10:45:35.179944 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 10:45:35.179944 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 10:45:35.179944 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 10:45:35.179944 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 10:45:35.181186 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 10:45:35.181186 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 06 10:45:35.181186 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 06 10:45:35.181186 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 06 10:45:35.181186 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 06 10:45:35.181186 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 06 10:45:35.181186 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 06 10:45:35.181186 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7490171a-7d11-4bb4-ad17-852fdbd2af8b could not be found. Jun 06 10:45:35.181186 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Jun 06 10:45:35.181186 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 10:45:35.181186 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Jun 06 10:45:35.181186 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 10:45:35.181186 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 10:45:35.181186 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 10:45:35.181186 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 10:45:35.181186 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 10:45:35.181186 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7490171a-7d11-4bb4-ad17-852fdbd2af8b could not be found. Jun 06 10:45:35.181186 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Jun 06 10:45:35.182664 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-ba32abf1-bc57-4567-8950-46101caa0956 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Returning 404 to user: Instance 7490171a-7d11-4bb4-ad17-852fdbd2af8b could not be found. {{(pid=129349) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 10:45:35.182664 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-ba32abf1-bc57-4567-8950-46101caa0956 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] 10.222.0.42 "GET /compute/v2.1/servers/7490171a-7d11-4bb4-ad17-852fdbd2af8b" status: 404 len: 111 microversion: 2.1 time: 0.031829 Jun 06 10:45:35.182664 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 406/792] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:45:35 2022] GET /compute/v2.1/servers/7490171a-7d11-4bb4-ad17-852fdbd2af8b => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 06 10:45:35.187440 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-60014ccf-e2be-410f-a8b5-2bbf304ea959 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Calling method '.version_select at 0x7f8fd81bd1f0>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:45:35.205266 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-60014ccf-e2be-410f-a8b5-2bbf304ea959 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-347975990" status: 202 len: 0 microversion: 2.1 time: 0.021807 Jun 06 10:45:35.205845 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 387/793] 10.222.0.42 () {58 vars in 1217 bytes} [Mon Jun 6 10:45:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-347975990 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 06 10:45:36.081407 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-ca277947-52ae-4f40-a6fc-f6ededdbecce tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:45:36.081898 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-ca277947-52ae-4f40-a6fc-f6ededdbecce tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] [instance: 3827eb37-6346-4a31-a6e5-25b90628827c] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:45:36.088244 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-ca277947-52ae-4f40-a6fc-f6ededdbecce tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:45:36.088690 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-ca277947-52ae-4f40-a6fc-f6ededdbecce tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:45:36.089455 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-ca277947-52ae-4f40-a6fc-f6ededdbecce tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:45:36.089882 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-ca277947-52ae-4f40-a6fc-f6ededdbecce tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:45:36.172203 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.objects.instance [None req-ca277947-52ae-4f40-a6fc-f6ededdbecce tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lazy-loading 'services' on Instance uuid 3827eb37-6346-4a31-a6e5-25b90628827c {{(pid=129349) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 06 10:45:36.246811 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-ca277947-52ae-4f40-a6fc-f6ededdbecce tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] 10.222.0.42 "DELETE /compute/v2.1/servers/3827eb37-6346-4a31-a6e5-25b90628827c/os-volume_attachments/ce183db7-fc9b-4b15-a86a-e931704dc836" status: 202 len: 0 microversion: 2.1 time: 0.169445 Jun 06 10:45:36.247392 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 407/794] 10.222.0.42 () {58 vars in 1415 bytes} [Mon Jun 6 10:45:36 2022] DELETE /compute/v2.1/servers/3827eb37-6346-4a31-a6e5-25b90628827c/os-volume_attachments/ce183db7-fc9b-4b15-a86a-e931704dc836 => generated 0 bytes in 171 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 06 10:45:36.263564 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-e4f6985e-bae5-4543-88db-b24fab1ff7f1 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:45:36.264564 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-e4f6985e-bae5-4543-88db-b24fab1ff7f1 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] [instance: 3827eb37-6346-4a31-a6e5-25b90628827c] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:45:36.272039 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-e4f6985e-bae5-4543-88db-b24fab1ff7f1 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:45:36.272505 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-e4f6985e-bae5-4543-88db-b24fab1ff7f1 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:45:36.273492 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-e4f6985e-bae5-4543-88db-b24fab1ff7f1 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:45:36.273954 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-e4f6985e-bae5-4543-88db-b24fab1ff7f1 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:45:36.302904 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-e4f6985e-bae5-4543-88db-b24fab1ff7f1 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] 10.222.0.42 "GET /compute/v2.1/servers/3827eb37-6346-4a31-a6e5-25b90628827c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050724 Jun 06 10:45:36.303451 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 388/795] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jun 6 10:45:36 2022] GET /compute/v2.1/servers/3827eb37-6346-4a31-a6e5-25b90628827c/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 10:45:37.317034 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-34153d31-581b-4376-8404-6e20f04ae4bd tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:45:37.318172 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-34153d31-581b-4376-8404-6e20f04ae4bd tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] [instance: 3827eb37-6346-4a31-a6e5-25b90628827c] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:45:37.324682 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-34153d31-581b-4376-8404-6e20f04ae4bd tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:45:37.325133 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-34153d31-581b-4376-8404-6e20f04ae4bd tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:45:37.325906 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-34153d31-581b-4376-8404-6e20f04ae4bd tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:45:37.326345 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-34153d31-581b-4376-8404-6e20f04ae4bd tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:45:37.356669 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-34153d31-581b-4376-8404-6e20f04ae4bd tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] 10.222.0.42 "GET /compute/v2.1/servers/3827eb37-6346-4a31-a6e5-25b90628827c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045183 Jun 06 10:45:37.357426 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 408/796] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jun 6 10:45:37 2022] GET /compute/v2.1/servers/3827eb37-6346-4a31-a6e5-25b90628827c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 06 10:45:38.369961 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-bc925f35-7042-464f-8cdc-87fed03f7f35 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:45:38.372031 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-bc925f35-7042-464f-8cdc-87fed03f7f35 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] [instance: 3827eb37-6346-4a31-a6e5-25b90628827c] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:45:38.385715 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-bc925f35-7042-464f-8cdc-87fed03f7f35 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:45:38.386222 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-bc925f35-7042-464f-8cdc-87fed03f7f35 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:45:38.387025 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-bc925f35-7042-464f-8cdc-87fed03f7f35 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:45:38.387464 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-bc925f35-7042-464f-8cdc-87fed03f7f35 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:45:38.458392 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-bc925f35-7042-464f-8cdc-87fed03f7f35 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] 10.222.0.42 "GET /compute/v2.1/servers/3827eb37-6346-4a31-a6e5-25b90628827c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.093755 Jun 06 10:45:38.462605 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 389/797] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jun 6 10:45:38 2022] GET /compute/v2.1/servers/3827eb37-6346-4a31-a6e5-25b90628827c/os-volume_attachments => generated 197 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 10:45:39.470494 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-e976c00e-ff04-439b-bb66-6158bdec8032 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:45:39.471443 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-e976c00e-ff04-439b-bb66-6158bdec8032 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] [instance: 3827eb37-6346-4a31-a6e5-25b90628827c] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:45:39.478797 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-e976c00e-ff04-439b-bb66-6158bdec8032 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:45:39.479237 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-e976c00e-ff04-439b-bb66-6158bdec8032 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:45:39.480023 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-e976c00e-ff04-439b-bb66-6158bdec8032 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:45:39.480454 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-e976c00e-ff04-439b-bb66-6158bdec8032 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:45:39.509514 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-e976c00e-ff04-439b-bb66-6158bdec8032 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] 10.222.0.42 "GET /compute/v2.1/servers/3827eb37-6346-4a31-a6e5-25b90628827c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042908 Jun 06 10:45:39.510050 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 409/798] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jun 6 10:45:39 2022] GET /compute/v2.1/servers/3827eb37-6346-4a31-a6e5-25b90628827c/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 06 10:45:39.572716 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-b86d85f3-c938-4b05-94d8-f1252550ddc0 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:45:39.573223 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-b86d85f3-c938-4b05-94d8-f1252550ddc0 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] [instance: 3827eb37-6346-4a31-a6e5-25b90628827c] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:45:39.579771 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-b86d85f3-c938-4b05-94d8-f1252550ddc0 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:45:39.580247 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-b86d85f3-c938-4b05-94d8-f1252550ddc0 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:45:39.581008 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-b86d85f3-c938-4b05-94d8-f1252550ddc0 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:45:39.581438 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-b86d85f3-c938-4b05-94d8-f1252550ddc0 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:45:39.605943 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-b86d85f3-c938-4b05-94d8-f1252550ddc0 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] [instance: 3827eb37-6346-4a31-a6e5-25b90628827c] Going to try to terminate instance {{(pid=129350) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 06 10:45:39.683160 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-b86d85f3-c938-4b05-94d8-f1252550ddc0 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] 10.222.0.42 "DELETE /compute/v2.1/servers/3827eb37-6346-4a31-a6e5-25b90628827c" status: 204 len: 0 microversion: 2.1 time: 0.114390 Jun 06 10:45:39.683865 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 390/799] 10.222.0.42 () {58 vars in 1238 bytes} [Mon Jun 6 10:45:39 2022] DELETE /compute/v2.1/servers/3827eb37-6346-4a31-a6e5-25b90628827c => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 06 10:45:39.691982 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-95e2ee56-4033-495c-9183-592e9e102a86 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:45:39.692592 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-95e2ee56-4033-495c-9183-592e9e102a86 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] [instance: 3827eb37-6346-4a31-a6e5-25b90628827c] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:45:39.699122 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-95e2ee56-4033-495c-9183-592e9e102a86 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:45:39.699565 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-95e2ee56-4033-495c-9183-592e9e102a86 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:45:39.700431 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-95e2ee56-4033-495c-9183-592e9e102a86 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:45:39.700862 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-95e2ee56-4033-495c-9183-592e9e102a86 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:45:39.829872 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-95e2ee56-4033-495c-9183-592e9e102a86 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ba341ea1ac34874bbfb8b2f713aea1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92244b4ae17d49bebe621e803bd9ae58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:45:39.837530 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-95e2ee56-4033-495c-9183-592e9e102a86 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] 10.222.0.42 "GET /compute/v2.1/servers/3827eb37-6346-4a31-a6e5-25b90628827c" status: 200 len: 1681 microversion: 2.1 time: 0.149354 Jun 06 10:45:39.838085 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 410/800] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:45:39 2022] GET /compute/v2.1/servers/3827eb37-6346-4a31-a6e5-25b90628827c => generated 1681 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:45:40.856353 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-acf5cfed-2f0f-45eb-81a8-232d7433d3dc tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:45:40.857142 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-acf5cfed-2f0f-45eb-81a8-232d7433d3dc tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] [instance: 3827eb37-6346-4a31-a6e5-25b90628827c] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:45:40.864454 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-acf5cfed-2f0f-45eb-81a8-232d7433d3dc tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:45:40.864928 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-acf5cfed-2f0f-45eb-81a8-232d7433d3dc tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:45:40.865851 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-acf5cfed-2f0f-45eb-81a8-232d7433d3dc tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:45:40.866285 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-acf5cfed-2f0f-45eb-81a8-232d7433d3dc tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:45:40.998064 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-acf5cfed-2f0f-45eb-81a8-232d7433d3dc tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ba341ea1ac34874bbfb8b2f713aea1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92244b4ae17d49bebe621e803bd9ae58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:45:41.005501 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-acf5cfed-2f0f-45eb-81a8-232d7433d3dc tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] 10.222.0.42 "GET /compute/v2.1/servers/3827eb37-6346-4a31-a6e5-25b90628827c" status: 200 len: 1681 microversion: 2.1 time: 0.153978 Jun 06 10:45:41.006062 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 391/801] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:45:40 2022] GET /compute/v2.1/servers/3827eb37-6346-4a31-a6e5-25b90628827c => generated 1681 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:45:42.024293 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-43d18d21-3b49-410d-85b8-1fbe0e19c557 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:45:42.025068 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-43d18d21-3b49-410d-85b8-1fbe0e19c557 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] [instance: 3827eb37-6346-4a31-a6e5-25b90628827c] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:45:42.032024 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-43d18d21-3b49-410d-85b8-1fbe0e19c557 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:45:42.032471 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-43d18d21-3b49-410d-85b8-1fbe0e19c557 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:45:42.033239 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-43d18d21-3b49-410d-85b8-1fbe0e19c557 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:45:42.033671 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-43d18d21-3b49-410d-85b8-1fbe0e19c557 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:45:42.176933 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-43d18d21-3b49-410d-85b8-1fbe0e19c557 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ba341ea1ac34874bbfb8b2f713aea1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92244b4ae17d49bebe621e803bd9ae58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:45:42.185069 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-43d18d21-3b49-410d-85b8-1fbe0e19c557 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] 10.222.0.42 "GET /compute/v2.1/servers/3827eb37-6346-4a31-a6e5-25b90628827c" status: 200 len: 1681 microversion: 2.1 time: 0.165530 Jun 06 10:45:42.185628 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 411/802] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:45:42 2022] GET /compute/v2.1/servers/3827eb37-6346-4a31-a6e5-25b90628827c => generated 1681 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:45:43.205071 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-459c5170-e54c-4b67-b840-6f2585a86298 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:45:43.206445 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-459c5170-e54c-4b67-b840-6f2585a86298 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] [instance: 3827eb37-6346-4a31-a6e5-25b90628827c] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:45:43.217469 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-459c5170-e54c-4b67-b840-6f2585a86298 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:45:43.217991 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-459c5170-e54c-4b67-b840-6f2585a86298 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:45:43.218847 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-459c5170-e54c-4b67-b840-6f2585a86298 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:45:43.219361 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-459c5170-e54c-4b67-b840-6f2585a86298 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:45:43.464412 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-459c5170-e54c-4b67-b840-6f2585a86298 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ba341ea1ac34874bbfb8b2f713aea1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92244b4ae17d49bebe621e803bd9ae58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:45:43.474278 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-459c5170-e54c-4b67-b840-6f2585a86298 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] 10.222.0.42 "GET /compute/v2.1/servers/3827eb37-6346-4a31-a6e5-25b90628827c" status: 200 len: 1681 microversion: 2.1 time: 0.274978 Jun 06 10:45:43.475579 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 392/803] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:45:43 2022] GET /compute/v2.1/servers/3827eb37-6346-4a31-a6e5-25b90628827c => generated 1681 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:45:43.924715 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [req-45101662-2cdb-443f-a1bb-79edc0947bb0 req-b6eb019c-5c10-4d5a-9972-3de6abd17b37 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3827eb37-6346-4a31-a6e5-25b90628827c", "name": "network-vif-deleted", "tag": "db231a6f-2db0-4cdc-851e-c9e6ca043bb0"}]} {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 10:45:43.941171 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [req-45101662-2cdb-443f-a1bb-79edc0947bb0 req-b6eb019c-5c10-4d5a-9972-3de6abd17b37 service nova] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:45:43.942459 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [req-45101662-2cdb-443f-a1bb-79edc0947bb0 req-b6eb019c-5c10-4d5a-9972-3de6abd17b37 service nova] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:45:43.966155 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.compute.server_external_events [req-45101662-2cdb-443f-a1bb-79edc0947bb0 req-b6eb019c-5c10-4d5a-9972-3de6abd17b37 service nova] Creating event network-vif-deleted:db231a6f-2db0-4cdc-851e-c9e6ca043bb0 for instance 3827eb37-6346-4a31-a6e5-25b90628827c on hv-cinder-84482 Jun 06 10:45:43.980464 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [req-45101662-2cdb-443f-a1bb-79edc0947bb0 req-b6eb019c-5c10-4d5a-9972-3de6abd17b37 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059640 Jun 06 10:45:43.984803 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 412/804] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Jun 6 10:45:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 10:45:44.492101 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-3a92324e-2299-442d-b24f-3c6d1f23d605 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:45:44.492721 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-3a92324e-2299-442d-b24f-3c6d1f23d605 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] [instance: 3827eb37-6346-4a31-a6e5-25b90628827c] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:45:44.511628 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-3a92324e-2299-442d-b24f-3c6d1f23d605 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:45:44.512135 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-3a92324e-2299-442d-b24f-3c6d1f23d605 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:45:44.513183 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-3a92324e-2299-442d-b24f-3c6d1f23d605 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:45:44.513691 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-3a92324e-2299-442d-b24f-3c6d1f23d605 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:45:44.529740 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.wsgi [None req-3a92324e-2299-442d-b24f-3c6d1f23d605 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] HTTP exception thrown: Instance 3827eb37-6346-4a31-a6e5-25b90628827c could not be found. Jun 06 10:45:44.531558 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-3a92324e-2299-442d-b24f-3c6d1f23d605 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Request method failure captured: Jun 06 10:45:44.531558 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: request: GET /compute/v2.1/servers/3827eb37-6346-4a31-a6e5-25b90628827c HTTP/1.1 Jun 06 10:45:44.531558 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: Accept: application/json Jun 06 10:45:44.531558 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: Accept-Encoding: identity Jun 06 10:45:44.531558 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: Connection: close Jun 06 10:45:44.531558 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: Content-Length: 0 Jun 06 10:45:44.531558 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: Content-Type: application/json Jun 06 10:45:44.531558 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: Host: 10.222.0.42 Jun 06 10:45:44.531558 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: Openstack-System-Scope: None Jun 06 10:45:44.531558 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: User-Agent: python-urllib3/1.26.9 Jun 06 10:45:44.531558 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Auth-Token: gAAAAABindpS5StX_xHu79Eyze6WiReBQv-1XmH_nbXfOmEXKeceOSLZM5qrKAT8lmCw6P5JEWqX6Nq9MOy22mDxxwSXFHT-nuQ59QQYMYHodXP_RU6pUiqpnXRk4PCXE--rTT-t8YJ-1daoywKB7L9jlYu_naOtOmjpMkLKZOiBTDyqPdUS4xY Jun 06 10:45:44.531558 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Domain-Id: None Jun 06 10:45:44.531558 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Domain-Name: None Jun 06 10:45:44.531558 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Identity-Status: Confirmed Jun 06 10:45:44.531558 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Is-Admin-Project: True Jun 06 10:45:44.531558 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Project-Domain-Id: default Jun 06 10:45:44.531558 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Project-Domain-Name: Default Jun 06 10:45:44.531558 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Project-Id: 92244b4ae17d49bebe621e803bd9ae58 Jun 06 10:45:44.531558 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Project-Name: tempest-AttachVolumeNegativeTest-363942965 Jun 06 10:45:44.531558 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Role: member,reader Jun 06 10:45:44.531558 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Roles: member,reader Jun 06 10:45:44.532987 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/92244b4ae17d49bebe621e803bd9ae58"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/92244b4ae17d49bebe621e803bd9ae58"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/92244b4ae17d49bebe621e803bd9ae58"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_92244b4ae17d49bebe621e803bd9ae58", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Jun 06 10:45:44.532987 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Tenant: tempest-AttachVolumeNegativeTest-363942965 Jun 06 10:45:44.532987 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Tenant-Id: 92244b4ae17d49bebe621e803bd9ae58 Jun 06 10:45:44.532987 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-363942965 Jun 06 10:45:44.532987 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-User: tempest-AttachVolumeNegativeTest-363942965-project Jun 06 10:45:44.532987 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-User-Domain-Id: default Jun 06 10:45:44.532987 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-User-Domain-Name: Default Jun 06 10:45:44.532987 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-User-Id: 7ba341ea1ac34874bbfb8b2f713aea1b Jun 06 10:45:44.532987 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-User-Name: tempest-AttachVolumeNegativeTest-363942965-project Jun 06 10:45:44.532987 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: method: > Jun 06 10:45:44.532987 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: exception: Instance 3827eb37-6346-4a31-a6e5-25b90628827c could not be found. Jun 06 10:45:44.532987 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: action_args: {'id': '3827eb37-6346-4a31-a6e5-25b90628827c'} Jun 06 10:45:44.533892 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 10:45:44.533892 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 10:45:44.533892 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 06 10:45:44.533892 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 06 10:45:44.533892 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 06 10:45:44.533892 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 06 10:45:44.533892 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 06 10:45:44.533892 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 06 10:45:44.533892 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 06 10:45:44.533892 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 06 10:45:44.533892 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3827eb37-6346-4a31-a6e5-25b90628827c could not be found. Jun 06 10:45:44.533892 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi Jun 06 10:45:44.533892 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 10:45:44.533892 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi Jun 06 10:45:44.533892 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 10:45:44.533892 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 10:45:44.533892 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 10:45:44.533892 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 10:45:44.533892 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 10:45:44.533892 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 10:45:44.535382 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 10:45:44.535382 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 06 10:45:44.535382 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 06 10:45:44.535382 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 06 10:45:44.535382 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 06 10:45:44.535382 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 06 10:45:44.535382 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 06 10:45:44.535382 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3827eb37-6346-4a31-a6e5-25b90628827c could not be found. Jun 06 10:45:44.535382 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi Jun 06 10:45:44.535382 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 10:45:44.535382 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi Jun 06 10:45:44.535382 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 10:45:44.535382 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 10:45:44.535382 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 10:45:44.535382 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 10:45:44.535382 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 10:45:44.535382 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3827eb37-6346-4a31-a6e5-25b90628827c could not be found. Jun 06 10:45:44.535382 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi Jun 06 10:45:44.536754 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-3a92324e-2299-442d-b24f-3c6d1f23d605 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Returning 404 to user: Instance 3827eb37-6346-4a31-a6e5-25b90628827c could not be found. {{(pid=129350) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 10:45:44.536754 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-3a92324e-2299-442d-b24f-3c6d1f23d605 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] 10.222.0.42 "GET /compute/v2.1/servers/3827eb37-6346-4a31-a6e5-25b90628827c" status: 404 len: 111 microversion: 2.1 time: 0.044903 Jun 06 10:45:44.536754 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 393/805] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:45:44 2022] GET /compute/v2.1/servers/3827eb37-6346-4a31-a6e5-25b90628827c => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 06 10:45:44.543091 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-2070ffb7-c435-4526-aa52-db7f1eb48f58 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Calling method '.version_select at 0x7f8fd8150a60>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:45:44.562169 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-2070ffb7-c435-4526-aa52-db7f1eb48f58 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1033199175" status: 202 len: 0 microversion: 2.1 time: 0.023569 Jun 06 10:45:44.566344 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 413/806] 10.222.0.42 () {58 vars in 1220 bytes} [Mon Jun 6 10:45:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1033199175 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 06 10:45:44.882825 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-8c926266-9c84-4ba8-be40-393eceff8d17 tempest-VolumesSnapshotTestJSON-1359047564 tempest-VolumesSnapshotTestJSON-1359047564-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:45:44.883330 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-8c926266-9c84-4ba8-be40-393eceff8d17 tempest-VolumesSnapshotTestJSON-1359047564 tempest-VolumesSnapshotTestJSON-1359047564-project] [instance: bdf19a3c-b5e9-473e-af16-cbef662bcff7] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:45:44.890002 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-8c926266-9c84-4ba8-be40-393eceff8d17 tempest-VolumesSnapshotTestJSON-1359047564 tempest-VolumesSnapshotTestJSON-1359047564-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:45:44.890719 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-8c926266-9c84-4ba8-be40-393eceff8d17 tempest-VolumesSnapshotTestJSON-1359047564 tempest-VolumesSnapshotTestJSON-1359047564-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:45:44.891550 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-8c926266-9c84-4ba8-be40-393eceff8d17 tempest-VolumesSnapshotTestJSON-1359047564 tempest-VolumesSnapshotTestJSON-1359047564-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:45:44.892104 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-8c926266-9c84-4ba8-be40-393eceff8d17 tempest-VolumesSnapshotTestJSON-1359047564 tempest-VolumesSnapshotTestJSON-1359047564-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:45:44.994368 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.objects.instance [None req-8c926266-9c84-4ba8-be40-393eceff8d17 tempest-VolumesSnapshotTestJSON-1359047564 tempest-VolumesSnapshotTestJSON-1359047564-project] Lazy-loading 'services' on Instance uuid bdf19a3c-b5e9-473e-af16-cbef662bcff7 {{(pid=129350) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 06 10:45:45.089834 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-8c926266-9c84-4ba8-be40-393eceff8d17 tempest-VolumesSnapshotTestJSON-1359047564 tempest-VolumesSnapshotTestJSON-1359047564-project] 10.222.0.42 "DELETE /compute/v2.1/servers/bdf19a3c-b5e9-473e-af16-cbef662bcff7/os-volume_attachments/c9bc4640-e6ee-42d9-8140-d2643f526489" status: 202 len: 0 microversion: 2.1 time: 0.213547 Jun 06 10:45:45.092205 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 394/807] 10.222.0.42 () {58 vars in 1415 bytes} [Mon Jun 6 10:45:44 2022] DELETE /compute/v2.1/servers/bdf19a3c-b5e9-473e-af16-cbef662bcff7/os-volume_attachments/c9bc4640-e6ee-42d9-8140-d2643f526489 => generated 0 bytes in 218 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 06 10:45:45.327816 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-80c7c185-f6f0-4ca4-b1b2-28ed4b5ab325 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Action: 'create', calling method: .version_select at 0x7f8fd82a7ee0>, body: {"keypair": {"name": "tempest-keypair-414202887", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKwGoNhyked71IZOBlimp/OkGnD7QSWlno9/tmWc3c8XpZaxzJxfuwve2pg2Z2CwxjevRmkAq27tSYRC86NusVDotkCLTlqFRHq0wP16mQpk6RJnxhvrMwA8lJILLBssqA=="}} {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 10:45:45.345410 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.quota [None req-80c7c185-f6f0-4ca4-b1b2-28ed4b5ab325 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Getting quotas for project 92244b4ae17d49bebe621e803bd9ae58. Resources: {'key_pairs'} {{(pid=129349) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 06 10:45:45.349481 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.quota [None req-80c7c185-f6f0-4ca4-b1b2-28ed4b5ab325 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Getting quotas for user 7ba341ea1ac34874bbfb8b2f713aea1b and project 92244b4ae17d49bebe621e803bd9ae58. Resources: {'key_pairs'} {{(pid=129349) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 06 10:45:45.372101 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-80c7c185-f6f0-4ca4-b1b2-28ed4b5ab325 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.048514 Jun 06 10:45:45.372993 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 414/808] 10.222.0.42 () {60 vars in 1158 bytes} [Mon Jun 6 10:45:45 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 10:45:46.236236 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-990a2718-33fe-479a-9706-4d84aa8b276e tempest-VolumesSnapshotTestJSON-1359047564 tempest-VolumesSnapshotTestJSON-1359047564-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:45:46.237007 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-990a2718-33fe-479a-9706-4d84aa8b276e tempest-VolumesSnapshotTestJSON-1359047564 tempest-VolumesSnapshotTestJSON-1359047564-project] [instance: bdf19a3c-b5e9-473e-af16-cbef662bcff7] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:45:46.245994 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-990a2718-33fe-479a-9706-4d84aa8b276e tempest-VolumesSnapshotTestJSON-1359047564 tempest-VolumesSnapshotTestJSON-1359047564-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:45:46.246373 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-990a2718-33fe-479a-9706-4d84aa8b276e tempest-VolumesSnapshotTestJSON-1359047564 tempest-VolumesSnapshotTestJSON-1359047564-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:45:46.247407 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-990a2718-33fe-479a-9706-4d84aa8b276e tempest-VolumesSnapshotTestJSON-1359047564 tempest-VolumesSnapshotTestJSON-1359047564-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:45:46.247872 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-990a2718-33fe-479a-9706-4d84aa8b276e tempest-VolumesSnapshotTestJSON-1359047564 tempest-VolumesSnapshotTestJSON-1359047564-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:45:46.276893 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-990a2718-33fe-479a-9706-4d84aa8b276e tempest-VolumesSnapshotTestJSON-1359047564 tempest-VolumesSnapshotTestJSON-1359047564-project] [instance: bdf19a3c-b5e9-473e-af16-cbef662bcff7] Going to try to terminate instance {{(pid=129350) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 06 10:45:46.317115 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG dbcounter [-] [129350] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=129350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 10:45:46.374862 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-990a2718-33fe-479a-9706-4d84aa8b276e tempest-VolumesSnapshotTestJSON-1359047564 tempest-VolumesSnapshotTestJSON-1359047564-project] 10.222.0.42 "DELETE /compute/v2.1/servers/bdf19a3c-b5e9-473e-af16-cbef662bcff7" status: 204 len: 0 microversion: 2.1 time: 0.142691 Jun 06 10:45:46.375803 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 395/809] 10.222.0.42 () {58 vars in 1238 bytes} [Mon Jun 6 10:45:46 2022] DELETE /compute/v2.1/servers/bdf19a3c-b5e9-473e-af16-cbef662bcff7 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 06 10:45:46.385315 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-f1daddf3-8c70-42e1-abdc-18153cdf40c0 tempest-VolumesSnapshotTestJSON-1359047564 tempest-VolumesSnapshotTestJSON-1359047564-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:45:46.386636 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-f1daddf3-8c70-42e1-abdc-18153cdf40c0 tempest-VolumesSnapshotTestJSON-1359047564 tempest-VolumesSnapshotTestJSON-1359047564-project] [instance: bdf19a3c-b5e9-473e-af16-cbef662bcff7] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:45:46.401680 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-f1daddf3-8c70-42e1-abdc-18153cdf40c0 tempest-VolumesSnapshotTestJSON-1359047564 tempest-VolumesSnapshotTestJSON-1359047564-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:45:46.402220 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-f1daddf3-8c70-42e1-abdc-18153cdf40c0 tempest-VolumesSnapshotTestJSON-1359047564 tempest-VolumesSnapshotTestJSON-1359047564-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:45:46.402906 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-f1daddf3-8c70-42e1-abdc-18153cdf40c0 tempest-VolumesSnapshotTestJSON-1359047564 tempest-VolumesSnapshotTestJSON-1359047564-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:45:46.405850 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-f1daddf3-8c70-42e1-abdc-18153cdf40c0 tempest-VolumesSnapshotTestJSON-1359047564 tempest-VolumesSnapshotTestJSON-1359047564-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:45:46.552202 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-f1daddf3-8c70-42e1-abdc-18153cdf40c0 tempest-VolumesSnapshotTestJSON-1359047564 tempest-VolumesSnapshotTestJSON-1359047564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d02effcaa64a2580cdd1613e7ff1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd93c9242f08447aaa597423812d5904d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:45:46.560311 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-f1daddf3-8c70-42e1-abdc-18153cdf40c0 tempest-VolumesSnapshotTestJSON-1359047564 tempest-VolumesSnapshotTestJSON-1359047564-project] 10.222.0.42 "GET /compute/v2.1/servers/bdf19a3c-b5e9-473e-af16-cbef662bcff7" status: 200 len: 1511 microversion: 2.1 time: 0.179553 Jun 06 10:45:46.560877 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 415/810] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:45:46 2022] GET /compute/v2.1/servers/bdf19a3c-b5e9-473e-af16-cbef662bcff7 => generated 1511 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:45:46.831841 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-52cd61d5-01fa-448f-90e3-9ce72a2b9729 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-433222082", "imageRef": "6eea2d98-354d-4083-b74c-abcbb97f9e1a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3bc95a68-dc60-40e7-808c-a65a4ba0072c"}], "security_groups": [{"name": "tempest-securitygroup--339031854"}], "key_name": "tempest-keypair-414202887", "user_data": "}} {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 10:45:46.981560 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.network.neutron [None req-52cd61d5-01fa-448f-90e3-9ce72a2b9729 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] validate_networks() for [('3bc95a68-dc60-40e7-808c-a65a4ba0072c', None, None, None, None, None)] {{(pid=129350) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 06 10:45:47.442578 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.virt.hardware [None req-52cd61d5-01fa-448f-90e3-9ce72a2b9729 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Flavor limits 0:0:0 {{(pid=129350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 06 10:45:47.443190 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.virt.hardware [None req-52cd61d5-01fa-448f-90e3-9ce72a2b9729 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Image limits 0:0:0 {{(pid=129350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 06 10:45:47.443490 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.virt.hardware [None req-52cd61d5-01fa-448f-90e3-9ce72a2b9729 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Flavor pref 0:0:0 {{(pid=129350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 06 10:45:47.444153 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.virt.hardware [None req-52cd61d5-01fa-448f-90e3-9ce72a2b9729 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Image pref 0:0:0 {{(pid=129350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 06 10:45:47.444571 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.virt.hardware [None req-52cd61d5-01fa-448f-90e3-9ce72a2b9729 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 06 10:45:47.453157 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-52cd61d5-01fa-448f-90e3-9ce72a2b9729 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:45:47.453817 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-52cd61d5-01fa-448f-90e3-9ce72a2b9729 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:45:47.454614 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-52cd61d5-01fa-448f-90e3-9ce72a2b9729 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:45:47.455047 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-52cd61d5-01fa-448f-90e3-9ce72a2b9729 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:45:47.472875 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.quota [None req-52cd61d5-01fa-448f-90e3-9ce72a2b9729 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Getting quotas for project 92244b4ae17d49bebe621e803bd9ae58. Resources: {'ram', 'cores', 'instances'} {{(pid=129350) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 06 10:45:47.477336 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.quota [None req-52cd61d5-01fa-448f-90e3-9ce72a2b9729 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Getting quotas for user 7ba341ea1ac34874bbfb8b2f713aea1b and project 92244b4ae17d49bebe621e803bd9ae58. Resources: {'ram', 'cores', 'instances'} {{(pid=129350) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 06 10:45:47.488207 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-52cd61d5-01fa-448f-90e3-9ce72a2b9729 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Going to run 1 instances... {{(pid=129350) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 06 10:45:47.490610 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-52cd61d5-01fa-448f-90e3-9ce72a2b9729 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] [instance: 2e2eb841-906d-4ab2-b15e-63f07cf3037d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6eea2d98-354d-4083-b74c-abcbb97f9e1a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129350) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 06 10:45:47.537049 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-52cd61d5-01fa-448f-90e3-9ce72a2b9729 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.709782 Jun 06 10:45:47.538249 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 396/811] 10.222.0.42 () {60 vars in 1146 bytes} [Mon Jun 6 10:45:46 2022] POST /compute/v2.1/servers => generated 401 bytes in 712 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 06 10:45:47.548190 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-9726fc4e-fc5d-49a3-8ea0-3e6082a9e55c tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:45:47.549366 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-9726fc4e-fc5d-49a3-8ea0-3e6082a9e55c tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] [instance: 2e2eb841-906d-4ab2-b15e-63f07cf3037d] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:45:47.581071 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-494f6317-7bed-4f40-8f7a-dfef564408db tempest-VolumesSnapshotTestJSON-1359047564 tempest-VolumesSnapshotTestJSON-1359047564-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:45:47.581729 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-494f6317-7bed-4f40-8f7a-dfef564408db tempest-VolumesSnapshotTestJSON-1359047564 tempest-VolumesSnapshotTestJSON-1359047564-project] [instance: bdf19a3c-b5e9-473e-af16-cbef662bcff7] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:45:47.590157 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-494f6317-7bed-4f40-8f7a-dfef564408db tempest-VolumesSnapshotTestJSON-1359047564 tempest-VolumesSnapshotTestJSON-1359047564-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:45:47.590683 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-494f6317-7bed-4f40-8f7a-dfef564408db tempest-VolumesSnapshotTestJSON-1359047564 tempest-VolumesSnapshotTestJSON-1359047564-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:45:47.591529 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-494f6317-7bed-4f40-8f7a-dfef564408db tempest-VolumesSnapshotTestJSON-1359047564 tempest-VolumesSnapshotTestJSON-1359047564-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:45:47.592138 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-494f6317-7bed-4f40-8f7a-dfef564408db tempest-VolumesSnapshotTestJSON-1359047564 tempest-VolumesSnapshotTestJSON-1359047564-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:45:47.645638 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-9726fc4e-fc5d-49a3-8ea0-3e6082a9e55c tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ba341ea1ac34874bbfb8b2f713aea1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92244b4ae17d49bebe621e803bd9ae58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:45:47.653455 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-9726fc4e-fc5d-49a3-8ea0-3e6082a9e55c tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] 10.222.0.42 "GET /compute/v2.1/servers/2e2eb841-906d-4ab2-b15e-63f07cf3037d" status: 200 len: 1240 microversion: 2.1 time: 0.108981 Jun 06 10:45:47.656412 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 416/812] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:45:47 2022] GET /compute/v2.1/servers/2e2eb841-906d-4ab2-b15e-63f07cf3037d => generated 1240 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:45:47.757675 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-494f6317-7bed-4f40-8f7a-dfef564408db tempest-VolumesSnapshotTestJSON-1359047564 tempest-VolumesSnapshotTestJSON-1359047564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d02effcaa64a2580cdd1613e7ff1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd93c9242f08447aaa597423812d5904d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:45:47.767611 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-494f6317-7bed-4f40-8f7a-dfef564408db tempest-VolumesSnapshotTestJSON-1359047564 tempest-VolumesSnapshotTestJSON-1359047564-project] 10.222.0.42 "GET /compute/v2.1/servers/bdf19a3c-b5e9-473e-af16-cbef662bcff7" status: 200 len: 1511 microversion: 2.1 time: 0.190582 Jun 06 10:45:47.769183 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 397/813] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:45:47 2022] GET /compute/v2.1/servers/bdf19a3c-b5e9-473e-af16-cbef662bcff7 => generated 1511 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 10:45:48.410508 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [req-e402ff27-6b34-428d-9c7a-2609001d8d59 req-a10de0f8-f35c-4876-8ac4-1813b390eed8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bdf19a3c-b5e9-473e-af16-cbef662bcff7", "name": "network-vif-deleted", "tag": "aae716a7-eb09-4f8a-a229-e598143818e8"}]} {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 10:45:48.423643 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [req-e402ff27-6b34-428d-9c7a-2609001d8d59 req-a10de0f8-f35c-4876-8ac4-1813b390eed8 service nova] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:45:48.424147 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [req-e402ff27-6b34-428d-9c7a-2609001d8d59 req-a10de0f8-f35c-4876-8ac4-1813b390eed8 service nova] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:45:48.437910 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.compute.server_external_events [req-e402ff27-6b34-428d-9c7a-2609001d8d59 req-a10de0f8-f35c-4876-8ac4-1813b390eed8 service nova] Creating event network-vif-deleted:aae716a7-eb09-4f8a-a229-e598143818e8 for instance bdf19a3c-b5e9-473e-af16-cbef662bcff7 on hv-cinder-84482 Jun 06 10:45:48.446388 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [req-e402ff27-6b34-428d-9c7a-2609001d8d59 req-a10de0f8-f35c-4876-8ac4-1813b390eed8 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039427 Jun 06 10:45:48.447266 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 417/814] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Jun 6 10:45:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 06 10:45:48.671194 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-cea85f85-40b4-4915-8b4a-8d717705641a tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:45:48.671935 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-cea85f85-40b4-4915-8b4a-8d717705641a tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] [instance: 2e2eb841-906d-4ab2-b15e-63f07cf3037d] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:45:48.680526 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-cea85f85-40b4-4915-8b4a-8d717705641a tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:45:48.680968 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-cea85f85-40b4-4915-8b4a-8d717705641a tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:45:48.681728 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-cea85f85-40b4-4915-8b4a-8d717705641a tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:45:48.682153 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-cea85f85-40b4-4915-8b4a-8d717705641a tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:45:48.745824 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-cea85f85-40b4-4915-8b4a-8d717705641a tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ba341ea1ac34874bbfb8b2f713aea1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92244b4ae17d49bebe621e803bd9ae58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:45:48.753527 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-cea85f85-40b4-4915-8b4a-8d717705641a tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] 10.222.0.42 "GET /compute/v2.1/servers/2e2eb841-906d-4ab2-b15e-63f07cf3037d" status: 200 len: 1310 microversion: 2.1 time: 0.087061 Jun 06 10:45:48.754086 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 398/815] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:45:48 2022] GET /compute/v2.1/servers/2e2eb841-906d-4ab2-b15e-63f07cf3037d => generated 1310 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:45:48.787026 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-1dcbfc83-5463-42ac-b4fb-faa34bbb1e86 tempest-VolumesSnapshotTestJSON-1359047564 tempest-VolumesSnapshotTestJSON-1359047564-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:45:48.789280 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-1dcbfc83-5463-42ac-b4fb-faa34bbb1e86 tempest-VolumesSnapshotTestJSON-1359047564 tempest-VolumesSnapshotTestJSON-1359047564-project] [instance: bdf19a3c-b5e9-473e-af16-cbef662bcff7] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:45:48.801134 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-1dcbfc83-5463-42ac-b4fb-faa34bbb1e86 tempest-VolumesSnapshotTestJSON-1359047564 tempest-VolumesSnapshotTestJSON-1359047564-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:45:48.806995 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-1dcbfc83-5463-42ac-b4fb-faa34bbb1e86 tempest-VolumesSnapshotTestJSON-1359047564 tempest-VolumesSnapshotTestJSON-1359047564-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:45:48.807976 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-1dcbfc83-5463-42ac-b4fb-faa34bbb1e86 tempest-VolumesSnapshotTestJSON-1359047564 tempest-VolumesSnapshotTestJSON-1359047564-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:45:48.808421 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-1dcbfc83-5463-42ac-b4fb-faa34bbb1e86 tempest-VolumesSnapshotTestJSON-1359047564 tempest-VolumesSnapshotTestJSON-1359047564-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:45:48.866897 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-1dcbfc83-5463-42ac-b4fb-faa34bbb1e86 tempest-VolumesSnapshotTestJSON-1359047564 tempest-VolumesSnapshotTestJSON-1359047564-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:45:48.868128 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-1dcbfc83-5463-42ac-b4fb-faa34bbb1e86 tempest-VolumesSnapshotTestJSON-1359047564 tempest-VolumesSnapshotTestJSON-1359047564-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:45:48.868762 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.objects.instance [None req-1dcbfc83-5463-42ac-b4fb-faa34bbb1e86 tempest-VolumesSnapshotTestJSON-1359047564 tempest-VolumesSnapshotTestJSON-1359047564-project] Lazy-loading 'fault' on Instance uuid bdf19a3c-b5e9-473e-af16-cbef662bcff7 {{(pid=129349) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 06 10:45:48.985499 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-1dcbfc83-5463-42ac-b4fb-faa34bbb1e86 tempest-VolumesSnapshotTestJSON-1359047564 tempest-VolumesSnapshotTestJSON-1359047564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d02effcaa64a2580cdd1613e7ff1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd93c9242f08447aaa597423812d5904d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:45:48.996211 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-1dcbfc83-5463-42ac-b4fb-faa34bbb1e86 tempest-VolumesSnapshotTestJSON-1359047564 tempest-VolumesSnapshotTestJSON-1359047564-project] 10.222.0.42 "GET /compute/v2.1/servers/bdf19a3c-b5e9-473e-af16-cbef662bcff7" status: 200 len: 1308 microversion: 2.1 time: 0.213652 Jun 06 10:45:48.996970 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 418/816] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:45:48 2022] GET /compute/v2.1/servers/bdf19a3c-b5e9-473e-af16-cbef662bcff7 => generated 1308 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:45:49.770752 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-283ac4ec-3f9f-4a68-afce-05e761072d1d tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:45:49.771478 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-283ac4ec-3f9f-4a68-afce-05e761072d1d tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] [instance: 2e2eb841-906d-4ab2-b15e-63f07cf3037d] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:45:49.778207 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-283ac4ec-3f9f-4a68-afce-05e761072d1d tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:45:49.778662 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-283ac4ec-3f9f-4a68-afce-05e761072d1d tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:45:49.779430 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-283ac4ec-3f9f-4a68-afce-05e761072d1d tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:45:49.779894 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-283ac4ec-3f9f-4a68-afce-05e761072d1d tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:45:49.984569 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-283ac4ec-3f9f-4a68-afce-05e761072d1d tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ba341ea1ac34874bbfb8b2f713aea1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92244b4ae17d49bebe621e803bd9ae58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:45:49.993201 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-283ac4ec-3f9f-4a68-afce-05e761072d1d tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] 10.222.0.42 "GET /compute/v2.1/servers/2e2eb841-906d-4ab2-b15e-63f07cf3037d" status: 200 len: 1365 microversion: 2.1 time: 0.226372 Jun 06 10:45:49.993873 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 399/817] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:45:49 2022] GET /compute/v2.1/servers/2e2eb841-906d-4ab2-b15e-63f07cf3037d => generated 1365 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 10:45:50.014917 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-f4711cd0-27ac-4180-8109-e0cdd209537b tempest-VolumesSnapshotTestJSON-1359047564 tempest-VolumesSnapshotTestJSON-1359047564-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:45:50.015544 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-f4711cd0-27ac-4180-8109-e0cdd209537b tempest-VolumesSnapshotTestJSON-1359047564 tempest-VolumesSnapshotTestJSON-1359047564-project] [instance: bdf19a3c-b5e9-473e-af16-cbef662bcff7] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:45:50.022757 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-f4711cd0-27ac-4180-8109-e0cdd209537b tempest-VolumesSnapshotTestJSON-1359047564 tempest-VolumesSnapshotTestJSON-1359047564-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:45:50.023457 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-f4711cd0-27ac-4180-8109-e0cdd209537b tempest-VolumesSnapshotTestJSON-1359047564 tempest-VolumesSnapshotTestJSON-1359047564-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:45:50.024463 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-f4711cd0-27ac-4180-8109-e0cdd209537b tempest-VolumesSnapshotTestJSON-1359047564 tempest-VolumesSnapshotTestJSON-1359047564-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:45:50.024900 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-f4711cd0-27ac-4180-8109-e0cdd209537b tempest-VolumesSnapshotTestJSON-1359047564 tempest-VolumesSnapshotTestJSON-1359047564-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:45:50.039903 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.wsgi [None req-f4711cd0-27ac-4180-8109-e0cdd209537b tempest-VolumesSnapshotTestJSON-1359047564 tempest-VolumesSnapshotTestJSON-1359047564-project] HTTP exception thrown: Instance bdf19a3c-b5e9-473e-af16-cbef662bcff7 could not be found. Jun 06 10:45:50.041715 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-f4711cd0-27ac-4180-8109-e0cdd209537b tempest-VolumesSnapshotTestJSON-1359047564 tempest-VolumesSnapshotTestJSON-1359047564-project] Request method failure captured: Jun 06 10:45:50.041715 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: request: GET /compute/v2.1/servers/bdf19a3c-b5e9-473e-af16-cbef662bcff7 HTTP/1.1 Jun 06 10:45:50.041715 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: Accept: application/json Jun 06 10:45:50.041715 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: Accept-Encoding: identity Jun 06 10:45:50.041715 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: Connection: close Jun 06 10:45:50.041715 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: Content-Length: 0 Jun 06 10:45:50.041715 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: Content-Type: application/json Jun 06 10:45:50.041715 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: Host: 10.222.0.42 Jun 06 10:45:50.041715 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: Openstack-System-Scope: None Jun 06 10:45:50.041715 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: User-Agent: python-urllib3/1.26.9 Jun 06 10:45:50.041715 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Auth-Token: gAAAAABindqoXjnBYEmeNLehgVGxM5jjKXhFQu7eZsCkpKEjEZoMMtheu0rIqETZepsQ9SYYCvP87bFuScGJS_0T1VZ0WudlhQchKL0ezQfaE5CBqpDYcKPxJJQW2SivbiTpPJ6CncqtBjbdNfoQ5-w6GYMJHBanqQirV442GW70AhaD5rQZrSs Jun 06 10:45:50.041715 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Domain-Id: None Jun 06 10:45:50.041715 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Domain-Name: None Jun 06 10:45:50.041715 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Identity-Status: Confirmed Jun 06 10:45:50.041715 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Is-Admin-Project: True Jun 06 10:45:50.041715 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Project-Domain-Id: default Jun 06 10:45:50.041715 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Project-Domain-Name: Default Jun 06 10:45:50.041715 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Project-Id: d93c9242f08447aaa597423812d5904d Jun 06 10:45:50.041715 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1359047564 Jun 06 10:45:50.041715 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Role: member,reader Jun 06 10:45:50.041715 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Roles: member,reader Jun 06 10:45:50.043268 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/d93c9242f08447aaa597423812d5904d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/d93c9242f08447aaa597423812d5904d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/d93c9242f08447aaa597423812d5904d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_d93c9242f08447aaa597423812d5904d", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Jun 06 10:45:50.043268 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Tenant: tempest-VolumesSnapshotTestJSON-1359047564 Jun 06 10:45:50.043268 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Tenant-Id: d93c9242f08447aaa597423812d5904d Jun 06 10:45:50.043268 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1359047564 Jun 06 10:45:50.043268 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-User: tempest-VolumesSnapshotTestJSON-1359047564-project Jun 06 10:45:50.043268 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-User-Domain-Id: default Jun 06 10:45:50.043268 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-User-Domain-Name: Default Jun 06 10:45:50.043268 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-User-Id: 63d02effcaa64a2580cdd1613e7ff1d8 Jun 06 10:45:50.043268 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-User-Name: tempest-VolumesSnapshotTestJSON-1359047564-project Jun 06 10:45:50.043268 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: method: > Jun 06 10:45:50.043268 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: exception: Instance bdf19a3c-b5e9-473e-af16-cbef662bcff7 could not be found. Jun 06 10:45:50.043268 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: action_args: {'id': 'bdf19a3c-b5e9-473e-af16-cbef662bcff7'} Jun 06 10:45:50.044211 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 10:45:50.044211 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 10:45:50.044211 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 06 10:45:50.044211 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 06 10:45:50.044211 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 06 10:45:50.044211 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 06 10:45:50.044211 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 06 10:45:50.044211 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 06 10:45:50.044211 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 06 10:45:50.044211 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 06 10:45:50.044211 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bdf19a3c-b5e9-473e-af16-cbef662bcff7 could not be found. Jun 06 10:45:50.044211 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Jun 06 10:45:50.044211 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 10:45:50.044211 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Jun 06 10:45:50.044211 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 10:45:50.044211 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 10:45:50.044211 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 10:45:50.044211 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 10:45:50.044211 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 10:45:50.044211 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 10:45:50.045626 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 10:45:50.045626 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 06 10:45:50.045626 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 06 10:45:50.045626 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 06 10:45:50.045626 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 06 10:45:50.045626 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 06 10:45:50.045626 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 06 10:45:50.045626 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bdf19a3c-b5e9-473e-af16-cbef662bcff7 could not be found. Jun 06 10:45:50.045626 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Jun 06 10:45:50.045626 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 10:45:50.045626 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Jun 06 10:45:50.045626 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 10:45:50.045626 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 10:45:50.045626 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 10:45:50.045626 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 10:45:50.045626 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 10:45:50.045626 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bdf19a3c-b5e9-473e-af16-cbef662bcff7 could not be found. Jun 06 10:45:50.045626 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Jun 06 10:45:50.046947 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-f4711cd0-27ac-4180-8109-e0cdd209537b tempest-VolumesSnapshotTestJSON-1359047564 tempest-VolumesSnapshotTestJSON-1359047564-project] Returning 404 to user: Instance bdf19a3c-b5e9-473e-af16-cbef662bcff7 could not be found. {{(pid=129349) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 10:45:50.046947 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-f4711cd0-27ac-4180-8109-e0cdd209537b tempest-VolumesSnapshotTestJSON-1359047564 tempest-VolumesSnapshotTestJSON-1359047564-project] 10.222.0.42 "GET /compute/v2.1/servers/bdf19a3c-b5e9-473e-af16-cbef662bcff7" status: 404 len: 111 microversion: 2.1 time: 0.032472 Jun 06 10:45:50.046947 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 419/818] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:45:50 2022] GET /compute/v2.1/servers/bdf19a3c-b5e9-473e-af16-cbef662bcff7 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 06 10:45:50.464403 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [req-921f8532-4585-40f3-bb6a-d47336f5afb3 req-62a0a60f-06e7-4234-adb1-68670755e436 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2e2eb841-906d-4ab2-b15e-63f07cf3037d", "tag": "1efcaca9-ec5c-468f-903b-a288d6bc742f"}]} {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 10:45:50.473230 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [req-921f8532-4585-40f3-bb6a-d47336f5afb3 req-62a0a60f-06e7-4234-adb1-68670755e436 service nova] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:45:50.473784 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [req-921f8532-4585-40f3-bb6a-d47336f5afb3 req-62a0a60f-06e7-4234-adb1-68670755e436 service nova] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:45:50.485972 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.compute.server_external_events [req-921f8532-4585-40f3-bb6a-d47336f5afb3 req-62a0a60f-06e7-4234-adb1-68670755e436 service nova] Creating event network-changed:1efcaca9-ec5c-468f-903b-a288d6bc742f for instance 2e2eb841-906d-4ab2-b15e-63f07cf3037d on hv-cinder-84482 Jun 06 10:45:50.492364 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [req-921f8532-4585-40f3-bb6a-d47336f5afb3 req-62a0a60f-06e7-4234-adb1-68670755e436 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031960 Jun 06 10:45:50.493580 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 400/819] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Jun 6 10:45:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 10:45:51.010679 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-0946a62a-e23d-453b-b649-10817aea20fc tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:45:51.011297 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-0946a62a-e23d-453b-b649-10817aea20fc tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] [instance: 2e2eb841-906d-4ab2-b15e-63f07cf3037d] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:45:51.017684 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-0946a62a-e23d-453b-b649-10817aea20fc tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:45:51.018210 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-0946a62a-e23d-453b-b649-10817aea20fc tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:45:51.018895 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-0946a62a-e23d-453b-b649-10817aea20fc tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:45:51.019338 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-0946a62a-e23d-453b-b649-10817aea20fc tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:45:51.151224 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-0946a62a-e23d-453b-b649-10817aea20fc tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ba341ea1ac34874bbfb8b2f713aea1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92244b4ae17d49bebe621e803bd9ae58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:45:51.158622 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-0946a62a-e23d-453b-b649-10817aea20fc tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] 10.222.0.42 "GET /compute/v2.1/servers/2e2eb841-906d-4ab2-b15e-63f07cf3037d" status: 200 len: 1365 microversion: 2.1 time: 0.151673 Jun 06 10:45:51.159172 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 420/820] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:45:51 2022] GET /compute/v2.1/servers/2e2eb841-906d-4ab2-b15e-63f07cf3037d => generated 1365 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:45:52.175807 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-50715c07-bf77-4dd4-9e60-efb2f723b8c4 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:45:52.176540 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-50715c07-bf77-4dd4-9e60-efb2f723b8c4 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] [instance: 2e2eb841-906d-4ab2-b15e-63f07cf3037d] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:45:52.183229 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-50715c07-bf77-4dd4-9e60-efb2f723b8c4 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:45:52.184017 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-50715c07-bf77-4dd4-9e60-efb2f723b8c4 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:45:52.185377 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-50715c07-bf77-4dd4-9e60-efb2f723b8c4 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:45:52.186123 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-50715c07-bf77-4dd4-9e60-efb2f723b8c4 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:45:52.323056 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-50715c07-bf77-4dd4-9e60-efb2f723b8c4 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ba341ea1ac34874bbfb8b2f713aea1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92244b4ae17d49bebe621e803bd9ae58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:45:52.330514 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-50715c07-bf77-4dd4-9e60-efb2f723b8c4 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] 10.222.0.42 "GET /compute/v2.1/servers/2e2eb841-906d-4ab2-b15e-63f07cf3037d" status: 200 len: 1365 microversion: 2.1 time: 0.159431 Jun 06 10:45:52.331072 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 401/821] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:45:52 2022] GET /compute/v2.1/servers/2e2eb841-906d-4ab2-b15e-63f07cf3037d => generated 1365 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:45:53.347405 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-1fba77b3-242e-457d-a535-c4c7c9a3bac0 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:45:53.348120 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-1fba77b3-242e-457d-a535-c4c7c9a3bac0 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] [instance: 2e2eb841-906d-4ab2-b15e-63f07cf3037d] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:45:53.355685 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-1fba77b3-242e-457d-a535-c4c7c9a3bac0 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:45:53.356161 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-1fba77b3-242e-457d-a535-c4c7c9a3bac0 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:45:53.356930 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-1fba77b3-242e-457d-a535-c4c7c9a3bac0 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:45:53.357472 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-1fba77b3-242e-457d-a535-c4c7c9a3bac0 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:45:53.731757 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-1fba77b3-242e-457d-a535-c4c7c9a3bac0 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ba341ea1ac34874bbfb8b2f713aea1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92244b4ae17d49bebe621e803bd9ae58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:45:53.739420 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-1fba77b3-242e-457d-a535-c4c7c9a3bac0 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] 10.222.0.42 "GET /compute/v2.1/servers/2e2eb841-906d-4ab2-b15e-63f07cf3037d" status: 200 len: 1365 microversion: 2.1 time: 0.395701 Jun 06 10:45:53.740071 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 421/822] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:45:53 2022] GET /compute/v2.1/servers/2e2eb841-906d-4ab2-b15e-63f07cf3037d => generated 1365 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:45:54.756344 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-3462789c-5048-49f2-b036-874edc0f6121 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:45:54.756986 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-3462789c-5048-49f2-b036-874edc0f6121 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] [instance: 2e2eb841-906d-4ab2-b15e-63f07cf3037d] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:45:54.763750 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-3462789c-5048-49f2-b036-874edc0f6121 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:45:54.764252 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-3462789c-5048-49f2-b036-874edc0f6121 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:45:54.765051 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-3462789c-5048-49f2-b036-874edc0f6121 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:45:54.765525 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-3462789c-5048-49f2-b036-874edc0f6121 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:45:54.894701 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-3462789c-5048-49f2-b036-874edc0f6121 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ba341ea1ac34874bbfb8b2f713aea1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92244b4ae17d49bebe621e803bd9ae58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:45:54.902597 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-3462789c-5048-49f2-b036-874edc0f6121 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] 10.222.0.42 "GET /compute/v2.1/servers/2e2eb841-906d-4ab2-b15e-63f07cf3037d" status: 200 len: 1365 microversion: 2.1 time: 0.150118 Jun 06 10:45:54.903076 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 402/823] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:45:54 2022] GET /compute/v2.1/servers/2e2eb841-906d-4ab2-b15e-63f07cf3037d => generated 1365 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:45:55.919943 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-7c983f5d-564d-40da-a037-dcf1258e5341 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:45:55.920550 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-7c983f5d-564d-40da-a037-dcf1258e5341 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] [instance: 2e2eb841-906d-4ab2-b15e-63f07cf3037d] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:45:55.929915 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-7c983f5d-564d-40da-a037-dcf1258e5341 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:45:55.930355 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-7c983f5d-564d-40da-a037-dcf1258e5341 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:45:55.931135 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-7c983f5d-564d-40da-a037-dcf1258e5341 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:45:55.931578 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-7c983f5d-564d-40da-a037-dcf1258e5341 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:45:56.067866 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-7c983f5d-564d-40da-a037-dcf1258e5341 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ba341ea1ac34874bbfb8b2f713aea1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92244b4ae17d49bebe621e803bd9ae58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:45:56.075361 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-7c983f5d-564d-40da-a037-dcf1258e5341 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] 10.222.0.42 "GET /compute/v2.1/servers/2e2eb841-906d-4ab2-b15e-63f07cf3037d" status: 200 len: 1365 microversion: 2.1 time: 0.160164 Jun 06 10:45:56.075948 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 422/824] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:45:55 2022] GET /compute/v2.1/servers/2e2eb841-906d-4ab2-b15e-63f07cf3037d => generated 1365 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:45:57.092436 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-76f34997-e23c-4969-be45-9955b2a5d902 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:45:57.093059 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-76f34997-e23c-4969-be45-9955b2a5d902 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] [instance: 2e2eb841-906d-4ab2-b15e-63f07cf3037d] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:45:57.099592 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-76f34997-e23c-4969-be45-9955b2a5d902 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:45:57.100076 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-76f34997-e23c-4969-be45-9955b2a5d902 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:45:57.100838 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-76f34997-e23c-4969-be45-9955b2a5d902 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:45:57.101270 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-76f34997-e23c-4969-be45-9955b2a5d902 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:45:57.228339 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-76f34997-e23c-4969-be45-9955b2a5d902 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ba341ea1ac34874bbfb8b2f713aea1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92244b4ae17d49bebe621e803bd9ae58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:45:57.235698 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-76f34997-e23c-4969-be45-9955b2a5d902 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] 10.222.0.42 "GET /compute/v2.1/servers/2e2eb841-906d-4ab2-b15e-63f07cf3037d" status: 200 len: 1365 microversion: 2.1 time: 0.147049 Jun 06 10:45:57.236278 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 403/825] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:45:57 2022] GET /compute/v2.1/servers/2e2eb841-906d-4ab2-b15e-63f07cf3037d => generated 1365 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:45:58.253138 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-9e545b50-95b1-433d-93db-d532b9efd8a1 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:45:58.253745 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-9e545b50-95b1-433d-93db-d532b9efd8a1 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] [instance: 2e2eb841-906d-4ab2-b15e-63f07cf3037d] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:45:58.256545 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG dbcounter [-] [129349] Writing DB stats nova_cell0:SELECT=6 {{(pid=129349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 10:45:58.262046 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-9e545b50-95b1-433d-93db-d532b9efd8a1 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:45:58.262746 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-9e545b50-95b1-433d-93db-d532b9efd8a1 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:45:58.263503 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-9e545b50-95b1-433d-93db-d532b9efd8a1 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:45:58.263963 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-9e545b50-95b1-433d-93db-d532b9efd8a1 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:45:58.266609 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG dbcounter [-] [129349] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=129349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 10:45:58.396345 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-9e545b50-95b1-433d-93db-d532b9efd8a1 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ba341ea1ac34874bbfb8b2f713aea1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92244b4ae17d49bebe621e803bd9ae58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:45:58.403853 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-9e545b50-95b1-433d-93db-d532b9efd8a1 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] 10.222.0.42 "GET /compute/v2.1/servers/2e2eb841-906d-4ab2-b15e-63f07cf3037d" status: 200 len: 1365 microversion: 2.1 time: 0.154497 Jun 06 10:45:58.404402 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 423/826] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:45:58 2022] GET /compute/v2.1/servers/2e2eb841-906d-4ab2-b15e-63f07cf3037d => generated 1365 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:45:59.421325 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-9e0c53ec-1f4a-4716-a79b-67ed81fdc42f tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:45:59.421945 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-9e0c53ec-1f4a-4716-a79b-67ed81fdc42f tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] [instance: 2e2eb841-906d-4ab2-b15e-63f07cf3037d] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:45:59.423915 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG dbcounter [-] [129350] Writing DB stats nova_cell0:SELECT=2 {{(pid=129350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 10:45:59.424735 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG dbcounter [-] [129350] Writing DB stats nova_cell0:SELECT=6 {{(pid=129350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 10:45:59.425748 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG dbcounter [-] [129350] Writing DB stats nova_api:SELECT=76,nova_api:UPDATE=3,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=129350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 10:45:59.431373 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-9e0c53ec-1f4a-4716-a79b-67ed81fdc42f tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:45:59.431873 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-9e0c53ec-1f4a-4716-a79b-67ed81fdc42f tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:45:59.432657 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-9e0c53ec-1f4a-4716-a79b-67ed81fdc42f tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:45:59.433097 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-9e0c53ec-1f4a-4716-a79b-67ed81fdc42f tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:45:59.572786 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-9e0c53ec-1f4a-4716-a79b-67ed81fdc42f tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ba341ea1ac34874bbfb8b2f713aea1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92244b4ae17d49bebe621e803bd9ae58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:45:59.580075 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-9e0c53ec-1f4a-4716-a79b-67ed81fdc42f tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] 10.222.0.42 "GET /compute/v2.1/servers/2e2eb841-906d-4ab2-b15e-63f07cf3037d" status: 200 len: 1365 microversion: 2.1 time: 0.162636 Jun 06 10:45:59.580894 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 404/827] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:45:59 2022] GET /compute/v2.1/servers/2e2eb841-906d-4ab2-b15e-63f07cf3037d => generated 1365 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:45:59.976676 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-a0d75af5-c561-4623-b61a-51317afb0459 tempest-VolumesSnapshotTestJSON-1359047564 tempest-VolumesSnapshotTestJSON-1359047564-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1693687110", "imageRef": "6eea2d98-354d-4083-b74c-abcbb97f9e1a", "flavorRef": "452", "networks": [{"uuid": "2a66c6fe-6386-4a4f-89e8-25ae36074d2d"}]}} {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 10:45:59.983691 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG dbcounter [-] [129349] Writing DB stats nova_api:SELECT=60,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=129349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 10:46:00.030528 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.network.neutron [None req-a0d75af5-c561-4623-b61a-51317afb0459 tempest-VolumesSnapshotTestJSON-1359047564 tempest-VolumesSnapshotTestJSON-1359047564-project] validate_networks() for [('2a66c6fe-6386-4a4f-89e8-25ae36074d2d', None, None, None, None, None)] {{(pid=129349) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 06 10:46:00.377454 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.virt.hardware [None req-a0d75af5-c561-4623-b61a-51317afb0459 tempest-VolumesSnapshotTestJSON-1359047564 tempest-VolumesSnapshotTestJSON-1359047564-project] Flavor limits 0:0:0 {{(pid=129349) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 06 10:46:00.377878 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.virt.hardware [None req-a0d75af5-c561-4623-b61a-51317afb0459 tempest-VolumesSnapshotTestJSON-1359047564 tempest-VolumesSnapshotTestJSON-1359047564-project] Image limits 0:0:0 {{(pid=129349) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 06 10:46:00.378352 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.virt.hardware [None req-a0d75af5-c561-4623-b61a-51317afb0459 tempest-VolumesSnapshotTestJSON-1359047564 tempest-VolumesSnapshotTestJSON-1359047564-project] Flavor pref 0:0:0 {{(pid=129349) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 06 10:46:00.378761 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.virt.hardware [None req-a0d75af5-c561-4623-b61a-51317afb0459 tempest-VolumesSnapshotTestJSON-1359047564 tempest-VolumesSnapshotTestJSON-1359047564-project] Image pref 0:0:0 {{(pid=129349) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 06 10:46:00.379173 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.virt.hardware [None req-a0d75af5-c561-4623-b61a-51317afb0459 tempest-VolumesSnapshotTestJSON-1359047564 tempest-VolumesSnapshotTestJSON-1359047564-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129349) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 06 10:46:00.389072 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-a0d75af5-c561-4623-b61a-51317afb0459 tempest-VolumesSnapshotTestJSON-1359047564 tempest-VolumesSnapshotTestJSON-1359047564-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:46:00.389838 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-a0d75af5-c561-4623-b61a-51317afb0459 tempest-VolumesSnapshotTestJSON-1359047564 tempest-VolumesSnapshotTestJSON-1359047564-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:46:00.390300 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-a0d75af5-c561-4623-b61a-51317afb0459 tempest-VolumesSnapshotTestJSON-1359047564 tempest-VolumesSnapshotTestJSON-1359047564-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:46:00.390734 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-a0d75af5-c561-4623-b61a-51317afb0459 tempest-VolumesSnapshotTestJSON-1359047564 tempest-VolumesSnapshotTestJSON-1359047564-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:46:00.407878 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.quota [None req-a0d75af5-c561-4623-b61a-51317afb0459 tempest-VolumesSnapshotTestJSON-1359047564 tempest-VolumesSnapshotTestJSON-1359047564-project] Getting quotas for project d93c9242f08447aaa597423812d5904d. Resources: {'ram', 'cores', 'instances'} {{(pid=129349) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 06 10:46:00.411834 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.quota [None req-a0d75af5-c561-4623-b61a-51317afb0459 tempest-VolumesSnapshotTestJSON-1359047564 tempest-VolumesSnapshotTestJSON-1359047564-project] Getting quotas for user 63d02effcaa64a2580cdd1613e7ff1d8 and project d93c9242f08447aaa597423812d5904d. Resources: {'ram', 'cores', 'instances'} {{(pid=129349) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 06 10:46:00.422567 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-a0d75af5-c561-4623-b61a-51317afb0459 tempest-VolumesSnapshotTestJSON-1359047564 tempest-VolumesSnapshotTestJSON-1359047564-project] Going to run 1 instances... {{(pid=129349) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 06 10:46:00.424845 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-a0d75af5-c561-4623-b61a-51317afb0459 tempest-VolumesSnapshotTestJSON-1359047564 tempest-VolumesSnapshotTestJSON-1359047564-project] [instance: 85116c44-42bb-4ead-bff9-77f16c03bb13] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6eea2d98-354d-4083-b74c-abcbb97f9e1a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129349) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 06 10:46:00.470147 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-a0d75af5-c561-4623-b61a-51317afb0459 tempest-VolumesSnapshotTestJSON-1359047564 tempest-VolumesSnapshotTestJSON-1359047564-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.498057 Jun 06 10:46:00.470715 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 424/828] 10.222.0.42 () {60 vars in 1146 bytes} [Mon Jun 6 10:45:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 499 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 06 10:46:00.481370 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-24db02d3-02a6-4de1-94eb-d9321c187e50 tempest-VolumesSnapshotTestJSON-1359047564 tempest-VolumesSnapshotTestJSON-1359047564-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:46:00.481996 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-24db02d3-02a6-4de1-94eb-d9321c187e50 tempest-VolumesSnapshotTestJSON-1359047564 tempest-VolumesSnapshotTestJSON-1359047564-project] [instance: 85116c44-42bb-4ead-bff9-77f16c03bb13] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:46:00.539217 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-24db02d3-02a6-4de1-94eb-d9321c187e50 tempest-VolumesSnapshotTestJSON-1359047564 tempest-VolumesSnapshotTestJSON-1359047564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d02effcaa64a2580cdd1613e7ff1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd93c9242f08447aaa597423812d5904d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:46:00.545752 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-24db02d3-02a6-4de1-94eb-d9321c187e50 tempest-VolumesSnapshotTestJSON-1359047564 tempest-VolumesSnapshotTestJSON-1359047564-project] 10.222.0.42 "GET /compute/v2.1/servers/85116c44-42bb-4ead-bff9-77f16c03bb13" status: 200 len: 1219 microversion: 2.1 time: 0.068568 Jun 06 10:46:00.546304 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 405/829] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:46:00 2022] GET /compute/v2.1/servers/85116c44-42bb-4ead-bff9-77f16c03bb13 => generated 1219 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:46:00.597399 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-8ac7ed5c-e4b5-42f6-b981-81d330ea75f9 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:46:00.598171 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-8ac7ed5c-e4b5-42f6-b981-81d330ea75f9 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] [instance: 2e2eb841-906d-4ab2-b15e-63f07cf3037d] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:46:00.604849 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-8ac7ed5c-e4b5-42f6-b981-81d330ea75f9 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:46:00.605296 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-8ac7ed5c-e4b5-42f6-b981-81d330ea75f9 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:46:00.606098 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-8ac7ed5c-e4b5-42f6-b981-81d330ea75f9 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:46:00.606533 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-8ac7ed5c-e4b5-42f6-b981-81d330ea75f9 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:46:00.749162 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-8ac7ed5c-e4b5-42f6-b981-81d330ea75f9 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ba341ea1ac34874bbfb8b2f713aea1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92244b4ae17d49bebe621e803bd9ae58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:46:00.757641 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-8ac7ed5c-e4b5-42f6-b981-81d330ea75f9 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] 10.222.0.42 "GET /compute/v2.1/servers/2e2eb841-906d-4ab2-b15e-63f07cf3037d" status: 200 len: 1365 microversion: 2.1 time: 0.164131 Jun 06 10:46:00.758291 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 425/830] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:46:00 2022] GET /compute/v2.1/servers/2e2eb841-906d-4ab2-b15e-63f07cf3037d => generated 1365 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:46:01.562350 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-654cb117-1477-464c-b4c1-e33db0646828 tempest-VolumesSnapshotTestJSON-1359047564 tempest-VolumesSnapshotTestJSON-1359047564-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:46:01.562963 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-654cb117-1477-464c-b4c1-e33db0646828 tempest-VolumesSnapshotTestJSON-1359047564 tempest-VolumesSnapshotTestJSON-1359047564-project] [instance: 85116c44-42bb-4ead-bff9-77f16c03bb13] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:46:01.570299 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-654cb117-1477-464c-b4c1-e33db0646828 tempest-VolumesSnapshotTestJSON-1359047564 tempest-VolumesSnapshotTestJSON-1359047564-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:46:01.570745 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-654cb117-1477-464c-b4c1-e33db0646828 tempest-VolumesSnapshotTestJSON-1359047564 tempest-VolumesSnapshotTestJSON-1359047564-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:46:01.571508 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-654cb117-1477-464c-b4c1-e33db0646828 tempest-VolumesSnapshotTestJSON-1359047564 tempest-VolumesSnapshotTestJSON-1359047564-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:46:01.571974 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-654cb117-1477-464c-b4c1-e33db0646828 tempest-VolumesSnapshotTestJSON-1359047564 tempest-VolumesSnapshotTestJSON-1359047564-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:46:01.632006 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-654cb117-1477-464c-b4c1-e33db0646828 tempest-VolumesSnapshotTestJSON-1359047564 tempest-VolumesSnapshotTestJSON-1359047564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d02effcaa64a2580cdd1613e7ff1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd93c9242f08447aaa597423812d5904d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:46:01.639569 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-654cb117-1477-464c-b4c1-e33db0646828 tempest-VolumesSnapshotTestJSON-1359047564 tempest-VolumesSnapshotTestJSON-1359047564-project] 10.222.0.42 "GET /compute/v2.1/servers/85116c44-42bb-4ead-bff9-77f16c03bb13" status: 200 len: 1223 microversion: 2.1 time: 0.080985 Jun 06 10:46:01.640092 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 406/831] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:46:01 2022] GET /compute/v2.1/servers/85116c44-42bb-4ead-bff9-77f16c03bb13 => generated 1223 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:46:01.775070 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-f501e51b-ec40-496b-ba6b-ee9f5d3eeaa1 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:46:01.775714 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-f501e51b-ec40-496b-ba6b-ee9f5d3eeaa1 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] [instance: 2e2eb841-906d-4ab2-b15e-63f07cf3037d] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:46:01.782204 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-f501e51b-ec40-496b-ba6b-ee9f5d3eeaa1 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:46:01.782649 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-f501e51b-ec40-496b-ba6b-ee9f5d3eeaa1 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:46:01.783408 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-f501e51b-ec40-496b-ba6b-ee9f5d3eeaa1 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:46:01.783867 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-f501e51b-ec40-496b-ba6b-ee9f5d3eeaa1 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:46:01.915388 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-f501e51b-ec40-496b-ba6b-ee9f5d3eeaa1 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ba341ea1ac34874bbfb8b2f713aea1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92244b4ae17d49bebe621e803bd9ae58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:46:01.922685 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-f501e51b-ec40-496b-ba6b-ee9f5d3eeaa1 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] 10.222.0.42 "GET /compute/v2.1/servers/2e2eb841-906d-4ab2-b15e-63f07cf3037d" status: 200 len: 1365 microversion: 2.1 time: 0.152193 Jun 06 10:46:01.923244 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 426/832] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:46:01 2022] GET /compute/v2.1/servers/2e2eb841-906d-4ab2-b15e-63f07cf3037d => generated 1365 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:46:02.657448 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-14cdc53a-35f3-4519-b3ed-d53d05d2e413 tempest-VolumesSnapshotTestJSON-1359047564 tempest-VolumesSnapshotTestJSON-1359047564-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:46:02.657998 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-14cdc53a-35f3-4519-b3ed-d53d05d2e413 tempest-VolumesSnapshotTestJSON-1359047564 tempest-VolumesSnapshotTestJSON-1359047564-project] [instance: 85116c44-42bb-4ead-bff9-77f16c03bb13] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:46:02.664540 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-14cdc53a-35f3-4519-b3ed-d53d05d2e413 tempest-VolumesSnapshotTestJSON-1359047564 tempest-VolumesSnapshotTestJSON-1359047564-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:46:02.664991 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-14cdc53a-35f3-4519-b3ed-d53d05d2e413 tempest-VolumesSnapshotTestJSON-1359047564 tempest-VolumesSnapshotTestJSON-1359047564-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:46:02.665749 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-14cdc53a-35f3-4519-b3ed-d53d05d2e413 tempest-VolumesSnapshotTestJSON-1359047564 tempest-VolumesSnapshotTestJSON-1359047564-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:46:02.666212 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-14cdc53a-35f3-4519-b3ed-d53d05d2e413 tempest-VolumesSnapshotTestJSON-1359047564 tempest-VolumesSnapshotTestJSON-1359047564-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:46:02.727143 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-14cdc53a-35f3-4519-b3ed-d53d05d2e413 tempest-VolumesSnapshotTestJSON-1359047564 tempest-VolumesSnapshotTestJSON-1359047564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d02effcaa64a2580cdd1613e7ff1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd93c9242f08447aaa597423812d5904d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:46:02.734548 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-14cdc53a-35f3-4519-b3ed-d53d05d2e413 tempest-VolumesSnapshotTestJSON-1359047564 tempest-VolumesSnapshotTestJSON-1359047564-project] 10.222.0.42 "GET /compute/v2.1/servers/85116c44-42bb-4ead-bff9-77f16c03bb13" status: 200 len: 1271 microversion: 2.1 time: 0.081057 Jun 06 10:46:02.735300 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 407/833] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:46:02 2022] GET /compute/v2.1/servers/85116c44-42bb-4ead-bff9-77f16c03bb13 => generated 1271 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:46:02.939907 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-fd62562f-5587-4413-af55-ba4044578f24 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:46:02.941045 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-fd62562f-5587-4413-af55-ba4044578f24 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] [instance: 2e2eb841-906d-4ab2-b15e-63f07cf3037d] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:46:02.949004 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-fd62562f-5587-4413-af55-ba4044578f24 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:46:02.949448 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-fd62562f-5587-4413-af55-ba4044578f24 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:46:02.950222 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-fd62562f-5587-4413-af55-ba4044578f24 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:46:02.950651 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-fd62562f-5587-4413-af55-ba4044578f24 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:46:03.138846 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-fd62562f-5587-4413-af55-ba4044578f24 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ba341ea1ac34874bbfb8b2f713aea1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92244b4ae17d49bebe621e803bd9ae58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:46:03.147915 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-fd62562f-5587-4413-af55-ba4044578f24 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] 10.222.0.42 "GET /compute/v2.1/servers/2e2eb841-906d-4ab2-b15e-63f07cf3037d" status: 200 len: 1365 microversion: 2.1 time: 0.211699 Jun 06 10:46:03.148695 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 427/834] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:46:02 2022] GET /compute/v2.1/servers/2e2eb841-906d-4ab2-b15e-63f07cf3037d => generated 1365 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:46:03.751777 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-517d1eb9-379e-4c0b-858a-3296fe8d4df8 tempest-VolumesSnapshotTestJSON-1359047564 tempest-VolumesSnapshotTestJSON-1359047564-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:46:03.752419 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-517d1eb9-379e-4c0b-858a-3296fe8d4df8 tempest-VolumesSnapshotTestJSON-1359047564 tempest-VolumesSnapshotTestJSON-1359047564-project] [instance: 85116c44-42bb-4ead-bff9-77f16c03bb13] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:46:03.758946 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-517d1eb9-379e-4c0b-858a-3296fe8d4df8 tempest-VolumesSnapshotTestJSON-1359047564 tempest-VolumesSnapshotTestJSON-1359047564-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:46:03.759393 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-517d1eb9-379e-4c0b-858a-3296fe8d4df8 tempest-VolumesSnapshotTestJSON-1359047564 tempest-VolumesSnapshotTestJSON-1359047564-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:46:03.760193 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-517d1eb9-379e-4c0b-858a-3296fe8d4df8 tempest-VolumesSnapshotTestJSON-1359047564 tempest-VolumesSnapshotTestJSON-1359047564-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:46:03.760614 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-517d1eb9-379e-4c0b-858a-3296fe8d4df8 tempest-VolumesSnapshotTestJSON-1359047564 tempest-VolumesSnapshotTestJSON-1359047564-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:46:03.969630 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-517d1eb9-379e-4c0b-858a-3296fe8d4df8 tempest-VolumesSnapshotTestJSON-1359047564 tempest-VolumesSnapshotTestJSON-1359047564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d02effcaa64a2580cdd1613e7ff1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd93c9242f08447aaa597423812d5904d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:46:03.977932 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-517d1eb9-379e-4c0b-858a-3296fe8d4df8 tempest-VolumesSnapshotTestJSON-1359047564 tempest-VolumesSnapshotTestJSON-1359047564-project] 10.222.0.42 "GET /compute/v2.1/servers/85116c44-42bb-4ead-bff9-77f16c03bb13" status: 200 len: 1319 microversion: 2.1 time: 0.230049 Jun 06 10:46:03.978495 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 408/835] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:46:03 2022] GET /compute/v2.1/servers/85116c44-42bb-4ead-bff9-77f16c03bb13 => generated 1319 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:46:04.165099 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-26969068-a2da-4e4e-8fe8-cabab9f789f5 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:46:04.165715 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-26969068-a2da-4e4e-8fe8-cabab9f789f5 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] [instance: 2e2eb841-906d-4ab2-b15e-63f07cf3037d] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:46:04.172154 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-26969068-a2da-4e4e-8fe8-cabab9f789f5 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:46:04.172604 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-26969068-a2da-4e4e-8fe8-cabab9f789f5 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:46:04.173365 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-26969068-a2da-4e4e-8fe8-cabab9f789f5 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:46:04.173795 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-26969068-a2da-4e4e-8fe8-cabab9f789f5 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:46:04.349885 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [req-b3ca5312-3382-43ec-a04c-b05948ea5a2f req-4e72bb5e-41e0-469e-9d9a-c33ceaf3f250 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "85116c44-42bb-4ead-bff9-77f16c03bb13", "tag": "02dcf782-d6e1-4f3a-a444-37498d1ac5d9"}]} {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 10:46:04.361202 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [req-b3ca5312-3382-43ec-a04c-b05948ea5a2f req-4e72bb5e-41e0-469e-9d9a-c33ceaf3f250 service nova] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:46:04.362215 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [req-b3ca5312-3382-43ec-a04c-b05948ea5a2f req-4e72bb5e-41e0-469e-9d9a-c33ceaf3f250 service nova] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:46:04.381734 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.compute.server_external_events [req-b3ca5312-3382-43ec-a04c-b05948ea5a2f req-4e72bb5e-41e0-469e-9d9a-c33ceaf3f250 service nova] Creating event network-changed:02dcf782-d6e1-4f3a-a444-37498d1ac5d9 for instance 85116c44-42bb-4ead-bff9-77f16c03bb13 on hv-cinder-84482 Jun 06 10:46:04.391141 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [req-b3ca5312-3382-43ec-a04c-b05948ea5a2f req-4e72bb5e-41e0-469e-9d9a-c33ceaf3f250 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045411 Jun 06 10:46:04.391970 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 409/836] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Jun 6 10:46:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 06 10:46:04.450953 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-26969068-a2da-4e4e-8fe8-cabab9f789f5 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ba341ea1ac34874bbfb8b2f713aea1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92244b4ae17d49bebe621e803bd9ae58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:46:04.460760 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-26969068-a2da-4e4e-8fe8-cabab9f789f5 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] 10.222.0.42 "GET /compute/v2.1/servers/2e2eb841-906d-4ab2-b15e-63f07cf3037d" status: 200 len: 1365 microversion: 2.1 time: 0.299665 Jun 06 10:46:04.461919 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 428/837] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:46:04 2022] GET /compute/v2.1/servers/2e2eb841-906d-4ab2-b15e-63f07cf3037d => generated 1365 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:46:04.518880 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [req-895f942a-99ca-43d1-9d6a-4f292c594b76 req-07d6e4c8-4ba0-45cc-ad53-bb1e879f887e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e2eb841-906d-4ab2-b15e-63f07cf3037d", "name": "network-vif-plugged", "status": "completed", "tag": "1efcaca9-ec5c-468f-903b-a288d6bc742f"}]} {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 10:46:04.531692 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [req-895f942a-99ca-43d1-9d6a-4f292c594b76 req-07d6e4c8-4ba0-45cc-ad53-bb1e879f887e service nova] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:46:04.532420 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [req-895f942a-99ca-43d1-9d6a-4f292c594b76 req-07d6e4c8-4ba0-45cc-ad53-bb1e879f887e service nova] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:46:04.545851 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.compute.server_external_events [req-895f942a-99ca-43d1-9d6a-4f292c594b76 req-07d6e4c8-4ba0-45cc-ad53-bb1e879f887e service nova] Creating event network-vif-plugged:1efcaca9-ec5c-468f-903b-a288d6bc742f for instance 2e2eb841-906d-4ab2-b15e-63f07cf3037d on hv-cinder-84482 Jun 06 10:46:04.552485 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [req-895f942a-99ca-43d1-9d6a-4f292c594b76 req-07d6e4c8-4ba0-45cc-ad53-bb1e879f887e service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036216 Jun 06 10:46:04.555736 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 410/838] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Jun 6 10:46:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 10:46:04.995665 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-e5c1dde2-894a-4bac-ab1a-eadef441f27f tempest-VolumesSnapshotTestJSON-1359047564 tempest-VolumesSnapshotTestJSON-1359047564-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:46:04.996306 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-e5c1dde2-894a-4bac-ab1a-eadef441f27f tempest-VolumesSnapshotTestJSON-1359047564 tempest-VolumesSnapshotTestJSON-1359047564-project] [instance: 85116c44-42bb-4ead-bff9-77f16c03bb13] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:46:05.002600 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-e5c1dde2-894a-4bac-ab1a-eadef441f27f tempest-VolumesSnapshotTestJSON-1359047564 tempest-VolumesSnapshotTestJSON-1359047564-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:46:05.003040 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-e5c1dde2-894a-4bac-ab1a-eadef441f27f tempest-VolumesSnapshotTestJSON-1359047564 tempest-VolumesSnapshotTestJSON-1359047564-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:46:05.003814 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-e5c1dde2-894a-4bac-ab1a-eadef441f27f tempest-VolumesSnapshotTestJSON-1359047564 tempest-VolumesSnapshotTestJSON-1359047564-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:46:05.004254 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-e5c1dde2-894a-4bac-ab1a-eadef441f27f tempest-VolumesSnapshotTestJSON-1359047564 tempest-VolumesSnapshotTestJSON-1359047564-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:46:05.135045 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-e5c1dde2-894a-4bac-ab1a-eadef441f27f tempest-VolumesSnapshotTestJSON-1359047564 tempest-VolumesSnapshotTestJSON-1359047564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d02effcaa64a2580cdd1613e7ff1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd93c9242f08447aaa597423812d5904d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:46:05.142604 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-e5c1dde2-894a-4bac-ab1a-eadef441f27f tempest-VolumesSnapshotTestJSON-1359047564 tempest-VolumesSnapshotTestJSON-1359047564-project] 10.222.0.42 "GET /compute/v2.1/servers/85116c44-42bb-4ead-bff9-77f16c03bb13" status: 200 len: 1319 microversion: 2.1 time: 0.150909 Jun 06 10:46:05.143161 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 429/839] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:46:04 2022] GET /compute/v2.1/servers/85116c44-42bb-4ead-bff9-77f16c03bb13 => generated 1319 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:46:05.480173 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-85ab147c-1cc2-44a1-8c7c-6389b0a368ee tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:46:05.480992 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-85ab147c-1cc2-44a1-8c7c-6389b0a368ee tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] [instance: 2e2eb841-906d-4ab2-b15e-63f07cf3037d] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:46:05.487183 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-85ab147c-1cc2-44a1-8c7c-6389b0a368ee tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:46:05.487628 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-85ab147c-1cc2-44a1-8c7c-6389b0a368ee tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:46:05.488412 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-85ab147c-1cc2-44a1-8c7c-6389b0a368ee tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:46:05.488840 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-85ab147c-1cc2-44a1-8c7c-6389b0a368ee tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:46:05.619084 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-85ab147c-1cc2-44a1-8c7c-6389b0a368ee tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ba341ea1ac34874bbfb8b2f713aea1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92244b4ae17d49bebe621e803bd9ae58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:46:05.626436 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-85ab147c-1cc2-44a1-8c7c-6389b0a368ee tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] 10.222.0.42 "GET /compute/v2.1/servers/2e2eb841-906d-4ab2-b15e-63f07cf3037d" status: 200 len: 1365 microversion: 2.1 time: 0.150965 Jun 06 10:46:05.626991 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 411/840] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:46:05 2022] GET /compute/v2.1/servers/2e2eb841-906d-4ab2-b15e-63f07cf3037d => generated 1365 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:46:06.159358 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-549816cb-849e-4607-9826-6451527c32fa tempest-VolumesSnapshotTestJSON-1359047564 tempest-VolumesSnapshotTestJSON-1359047564-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:46:06.160068 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-549816cb-849e-4607-9826-6451527c32fa tempest-VolumesSnapshotTestJSON-1359047564 tempest-VolumesSnapshotTestJSON-1359047564-project] [instance: 85116c44-42bb-4ead-bff9-77f16c03bb13] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:46:06.166688 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-549816cb-849e-4607-9826-6451527c32fa tempest-VolumesSnapshotTestJSON-1359047564 tempest-VolumesSnapshotTestJSON-1359047564-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:46:06.167132 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-549816cb-849e-4607-9826-6451527c32fa tempest-VolumesSnapshotTestJSON-1359047564 tempest-VolumesSnapshotTestJSON-1359047564-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:46:06.167923 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-549816cb-849e-4607-9826-6451527c32fa tempest-VolumesSnapshotTestJSON-1359047564 tempest-VolumesSnapshotTestJSON-1359047564-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:46:06.168355 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-549816cb-849e-4607-9826-6451527c32fa tempest-VolumesSnapshotTestJSON-1359047564 tempest-VolumesSnapshotTestJSON-1359047564-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:46:06.293891 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-549816cb-849e-4607-9826-6451527c32fa tempest-VolumesSnapshotTestJSON-1359047564 tempest-VolumesSnapshotTestJSON-1359047564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d02effcaa64a2580cdd1613e7ff1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd93c9242f08447aaa597423812d5904d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:46:06.301204 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-549816cb-849e-4607-9826-6451527c32fa tempest-VolumesSnapshotTestJSON-1359047564 tempest-VolumesSnapshotTestJSON-1359047564-project] 10.222.0.42 "GET /compute/v2.1/servers/85116c44-42bb-4ead-bff9-77f16c03bb13" status: 200 len: 1319 microversion: 2.1 time: 0.145681 Jun 06 10:46:06.302315 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 430/841] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:46:06 2022] GET /compute/v2.1/servers/85116c44-42bb-4ead-bff9-77f16c03bb13 => generated 1319 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:46:06.643478 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-e7878921-a32a-4ee5-9546-fa475614168b tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:46:06.644101 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-e7878921-a32a-4ee5-9546-fa475614168b tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] [instance: 2e2eb841-906d-4ab2-b15e-63f07cf3037d] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:46:06.650743 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-e7878921-a32a-4ee5-9546-fa475614168b tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:46:06.651184 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-e7878921-a32a-4ee5-9546-fa475614168b tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:46:06.651970 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-e7878921-a32a-4ee5-9546-fa475614168b tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:46:06.652401 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-e7878921-a32a-4ee5-9546-fa475614168b tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:46:06.780646 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-e7878921-a32a-4ee5-9546-fa475614168b tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ba341ea1ac34874bbfb8b2f713aea1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92244b4ae17d49bebe621e803bd9ae58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:46:06.788695 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-e7878921-a32a-4ee5-9546-fa475614168b tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] 10.222.0.42 "GET /compute/v2.1/servers/2e2eb841-906d-4ab2-b15e-63f07cf3037d" status: 200 len: 1365 microversion: 2.1 time: 0.149109 Jun 06 10:46:06.789252 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 412/842] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:46:06 2022] GET /compute/v2.1/servers/2e2eb841-906d-4ab2-b15e-63f07cf3037d => generated 1365 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:46:07.320953 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-f6fc25a3-22a8-43e8-836a-0f66020f1af0 tempest-VolumesSnapshotTestJSON-1359047564 tempest-VolumesSnapshotTestJSON-1359047564-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:46:07.321844 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-f6fc25a3-22a8-43e8-836a-0f66020f1af0 tempest-VolumesSnapshotTestJSON-1359047564 tempest-VolumesSnapshotTestJSON-1359047564-project] [instance: 85116c44-42bb-4ead-bff9-77f16c03bb13] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:46:07.329324 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-f6fc25a3-22a8-43e8-836a-0f66020f1af0 tempest-VolumesSnapshotTestJSON-1359047564 tempest-VolumesSnapshotTestJSON-1359047564-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:46:07.329767 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-f6fc25a3-22a8-43e8-836a-0f66020f1af0 tempest-VolumesSnapshotTestJSON-1359047564 tempest-VolumesSnapshotTestJSON-1359047564-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:46:07.330525 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-f6fc25a3-22a8-43e8-836a-0f66020f1af0 tempest-VolumesSnapshotTestJSON-1359047564 tempest-VolumesSnapshotTestJSON-1359047564-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:46:07.330955 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-f6fc25a3-22a8-43e8-836a-0f66020f1af0 tempest-VolumesSnapshotTestJSON-1359047564 tempest-VolumesSnapshotTestJSON-1359047564-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:46:07.469268 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-f6fc25a3-22a8-43e8-836a-0f66020f1af0 tempest-VolumesSnapshotTestJSON-1359047564 tempest-VolumesSnapshotTestJSON-1359047564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d02effcaa64a2580cdd1613e7ff1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd93c9242f08447aaa597423812d5904d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:46:07.477460 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-f6fc25a3-22a8-43e8-836a-0f66020f1af0 tempest-VolumesSnapshotTestJSON-1359047564 tempest-VolumesSnapshotTestJSON-1359047564-project] 10.222.0.42 "GET /compute/v2.1/servers/85116c44-42bb-4ead-bff9-77f16c03bb13" status: 200 len: 1319 microversion: 2.1 time: 0.162684 Jun 06 10:46:07.478042 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 431/843] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:46:07 2022] GET /compute/v2.1/servers/85116c44-42bb-4ead-bff9-77f16c03bb13 => generated 1319 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:46:07.805888 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-7648b73b-2a9f-45d8-a275-450851452611 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:46:07.806486 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-7648b73b-2a9f-45d8-a275-450851452611 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] [instance: 2e2eb841-906d-4ab2-b15e-63f07cf3037d] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:46:07.815757 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-7648b73b-2a9f-45d8-a275-450851452611 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:46:07.816238 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-7648b73b-2a9f-45d8-a275-450851452611 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:46:07.817005 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-7648b73b-2a9f-45d8-a275-450851452611 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:46:07.818130 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-7648b73b-2a9f-45d8-a275-450851452611 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:46:07.952002 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-7648b73b-2a9f-45d8-a275-450851452611 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ba341ea1ac34874bbfb8b2f713aea1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92244b4ae17d49bebe621e803bd9ae58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:46:07.959652 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-7648b73b-2a9f-45d8-a275-450851452611 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] 10.222.0.42 "GET /compute/v2.1/servers/2e2eb841-906d-4ab2-b15e-63f07cf3037d" status: 200 len: 1365 microversion: 2.1 time: 0.158229 Jun 06 10:46:07.960245 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 413/844] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:46:07 2022] GET /compute/v2.1/servers/2e2eb841-906d-4ab2-b15e-63f07cf3037d => generated 1365 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:46:08.495405 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-39ad311c-6ccf-4216-bd39-eb9d6bf2fd3f tempest-VolumesSnapshotTestJSON-1359047564 tempest-VolumesSnapshotTestJSON-1359047564-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:46:08.496071 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-39ad311c-6ccf-4216-bd39-eb9d6bf2fd3f tempest-VolumesSnapshotTestJSON-1359047564 tempest-VolumesSnapshotTestJSON-1359047564-project] [instance: 85116c44-42bb-4ead-bff9-77f16c03bb13] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:46:08.502702 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-39ad311c-6ccf-4216-bd39-eb9d6bf2fd3f tempest-VolumesSnapshotTestJSON-1359047564 tempest-VolumesSnapshotTestJSON-1359047564-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:46:08.503145 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-39ad311c-6ccf-4216-bd39-eb9d6bf2fd3f tempest-VolumesSnapshotTestJSON-1359047564 tempest-VolumesSnapshotTestJSON-1359047564-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:46:08.503942 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-39ad311c-6ccf-4216-bd39-eb9d6bf2fd3f tempest-VolumesSnapshotTestJSON-1359047564 tempest-VolumesSnapshotTestJSON-1359047564-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:46:08.504375 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-39ad311c-6ccf-4216-bd39-eb9d6bf2fd3f tempest-VolumesSnapshotTestJSON-1359047564 tempest-VolumesSnapshotTestJSON-1359047564-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:46:08.634902 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-39ad311c-6ccf-4216-bd39-eb9d6bf2fd3f tempest-VolumesSnapshotTestJSON-1359047564 tempest-VolumesSnapshotTestJSON-1359047564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d02effcaa64a2580cdd1613e7ff1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd93c9242f08447aaa597423812d5904d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:46:08.642608 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-39ad311c-6ccf-4216-bd39-eb9d6bf2fd3f tempest-VolumesSnapshotTestJSON-1359047564 tempest-VolumesSnapshotTestJSON-1359047564-project] 10.222.0.42 "GET /compute/v2.1/servers/85116c44-42bb-4ead-bff9-77f16c03bb13" status: 200 len: 1319 microversion: 2.1 time: 0.151273 Jun 06 10:46:08.643117 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 432/845] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:46:08 2022] GET /compute/v2.1/servers/85116c44-42bb-4ead-bff9-77f16c03bb13 => generated 1319 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:46:08.975721 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-8fa09697-09ec-42b9-96dc-23cfcceaacf6 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:46:08.976374 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-8fa09697-09ec-42b9-96dc-23cfcceaacf6 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] [instance: 2e2eb841-906d-4ab2-b15e-63f07cf3037d] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:46:08.982660 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-8fa09697-09ec-42b9-96dc-23cfcceaacf6 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:46:08.983107 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-8fa09697-09ec-42b9-96dc-23cfcceaacf6 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:46:08.983882 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-8fa09697-09ec-42b9-96dc-23cfcceaacf6 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:46:08.984314 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-8fa09697-09ec-42b9-96dc-23cfcceaacf6 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:46:09.161034 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-8fa09697-09ec-42b9-96dc-23cfcceaacf6 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ba341ea1ac34874bbfb8b2f713aea1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92244b4ae17d49bebe621e803bd9ae58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:46:09.169569 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-8fa09697-09ec-42b9-96dc-23cfcceaacf6 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] 10.222.0.42 "GET /compute/v2.1/servers/2e2eb841-906d-4ab2-b15e-63f07cf3037d" status: 200 len: 1365 microversion: 2.1 time: 0.197871 Jun 06 10:46:09.170358 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 414/846] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:46:08 2022] GET /compute/v2.1/servers/2e2eb841-906d-4ab2-b15e-63f07cf3037d => generated 1365 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:46:09.660230 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-20d5c6ec-a2b2-4d2f-8772-8d56b2b6e997 tempest-VolumesSnapshotTestJSON-1359047564 tempest-VolumesSnapshotTestJSON-1359047564-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:46:09.660850 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-20d5c6ec-a2b2-4d2f-8772-8d56b2b6e997 tempest-VolumesSnapshotTestJSON-1359047564 tempest-VolumesSnapshotTestJSON-1359047564-project] [instance: 85116c44-42bb-4ead-bff9-77f16c03bb13] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:46:09.668895 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-20d5c6ec-a2b2-4d2f-8772-8d56b2b6e997 tempest-VolumesSnapshotTestJSON-1359047564 tempest-VolumesSnapshotTestJSON-1359047564-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:46:09.669332 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-20d5c6ec-a2b2-4d2f-8772-8d56b2b6e997 tempest-VolumesSnapshotTestJSON-1359047564 tempest-VolumesSnapshotTestJSON-1359047564-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:46:09.670120 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-20d5c6ec-a2b2-4d2f-8772-8d56b2b6e997 tempest-VolumesSnapshotTestJSON-1359047564 tempest-VolumesSnapshotTestJSON-1359047564-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:46:09.670558 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-20d5c6ec-a2b2-4d2f-8772-8d56b2b6e997 tempest-VolumesSnapshotTestJSON-1359047564 tempest-VolumesSnapshotTestJSON-1359047564-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:46:09.802461 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-20d5c6ec-a2b2-4d2f-8772-8d56b2b6e997 tempest-VolumesSnapshotTestJSON-1359047564 tempest-VolumesSnapshotTestJSON-1359047564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d02effcaa64a2580cdd1613e7ff1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd93c9242f08447aaa597423812d5904d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:46:09.810052 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-20d5c6ec-a2b2-4d2f-8772-8d56b2b6e997 tempest-VolumesSnapshotTestJSON-1359047564 tempest-VolumesSnapshotTestJSON-1359047564-project] 10.222.0.42 "GET /compute/v2.1/servers/85116c44-42bb-4ead-bff9-77f16c03bb13" status: 200 len: 1319 microversion: 2.1 time: 0.153814 Jun 06 10:46:09.810611 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 433/847] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:46:09 2022] GET /compute/v2.1/servers/85116c44-42bb-4ead-bff9-77f16c03bb13 => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:46:10.187537 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-69e7814c-812d-4dd4-9f4a-c930e1944b37 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:46:10.188209 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-69e7814c-812d-4dd4-9f4a-c930e1944b37 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] [instance: 2e2eb841-906d-4ab2-b15e-63f07cf3037d] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:46:10.195665 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-69e7814c-812d-4dd4-9f4a-c930e1944b37 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:46:10.196131 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-69e7814c-812d-4dd4-9f4a-c930e1944b37 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:46:10.196884 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-69e7814c-812d-4dd4-9f4a-c930e1944b37 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:46:10.197313 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-69e7814c-812d-4dd4-9f4a-c930e1944b37 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:46:10.215962 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG dbcounter [-] [129350] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=129350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 10:46:10.336314 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-69e7814c-812d-4dd4-9f4a-c930e1944b37 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ba341ea1ac34874bbfb8b2f713aea1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92244b4ae17d49bebe621e803bd9ae58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:46:10.347505 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-69e7814c-812d-4dd4-9f4a-c930e1944b37 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] 10.222.0.42 "GET /compute/v2.1/servers/2e2eb841-906d-4ab2-b15e-63f07cf3037d" status: 200 len: 1554 microversion: 2.1 time: 0.163706 Jun 06 10:46:10.349891 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 415/848] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:46:10 2022] GET /compute/v2.1/servers/2e2eb841-906d-4ab2-b15e-63f07cf3037d => generated 1554 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:46:10.390074 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-2034bd7d-a6ea-43dd-b552-dedc4d7aaea6 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:46:10.400332 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-2034bd7d-a6ea-43dd-b552-dedc4d7aaea6 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] [instance: 2e2eb841-906d-4ab2-b15e-63f07cf3037d] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:46:10.403072 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG dbcounter [-] [129349] Writing DB stats nova_cell0:SELECT=2 {{(pid=129349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 10:46:10.410219 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-2034bd7d-a6ea-43dd-b552-dedc4d7aaea6 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:46:10.410775 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-2034bd7d-a6ea-43dd-b552-dedc4d7aaea6 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:46:10.418704 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-2034bd7d-a6ea-43dd-b552-dedc4d7aaea6 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:46:10.419218 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-2034bd7d-a6ea-43dd-b552-dedc4d7aaea6 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:46:10.420840 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG dbcounter [-] [129349] Writing DB stats nova_cell0:SELECT=6 {{(pid=129349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 10:46:10.523214 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-2034bd7d-a6ea-43dd-b552-dedc4d7aaea6 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] 10.222.0.42 "GET /compute/v2.1/servers/2e2eb841-906d-4ab2-b15e-63f07cf3037d/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.149998 Jun 06 10:46:10.524113 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 434/849] 10.222.0.42 () {58 vars in 1274 bytes} [Mon Jun 6 10:46:10 2022] GET /compute/v2.1/servers/2e2eb841-906d-4ab2-b15e-63f07cf3037d/os-interface => generated 284 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 10:46:10.536462 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [req-004d027a-8c73-4a90-8aa5-a8f3a6947bb0 req-1115bd0e-ad66-410a-ad7d-bac5f09743f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85116c44-42bb-4ead-bff9-77f16c03bb13", "name": "network-vif-plugged", "status": "completed", "tag": "02dcf782-d6e1-4f3a-a444-37498d1ac5d9"}]} {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 10:46:10.559714 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG dbcounter [-] [129350] Writing DB stats nova_cell0:SELECT=2 {{(pid=129350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 10:46:10.566087 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [req-004d027a-8c73-4a90-8aa5-a8f3a6947bb0 req-1115bd0e-ad66-410a-ad7d-bac5f09743f1 service nova] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:46:10.567329 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [req-004d027a-8c73-4a90-8aa5-a8f3a6947bb0 req-1115bd0e-ad66-410a-ad7d-bac5f09743f1 service nova] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:46:10.588157 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.compute.server_external_events [req-004d027a-8c73-4a90-8aa5-a8f3a6947bb0 req-1115bd0e-ad66-410a-ad7d-bac5f09743f1 service nova] Creating event network-vif-plugged:02dcf782-d6e1-4f3a-a444-37498d1ac5d9 for instance 85116c44-42bb-4ead-bff9-77f16c03bb13 on hv-cinder-84482 Jun 06 10:46:10.594114 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [req-004d027a-8c73-4a90-8aa5-a8f3a6947bb0 req-1115bd0e-ad66-410a-ad7d-bac5f09743f1 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061442 Jun 06 10:46:10.595267 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 416/850] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Jun 6 10:46:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 10:46:10.831015 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-f2e72be6-55d2-40ea-9cd5-cba4cb8ee088 tempest-VolumesSnapshotTestJSON-1359047564 tempest-VolumesSnapshotTestJSON-1359047564-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:46:10.831626 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-f2e72be6-55d2-40ea-9cd5-cba4cb8ee088 tempest-VolumesSnapshotTestJSON-1359047564 tempest-VolumesSnapshotTestJSON-1359047564-project] [instance: 85116c44-42bb-4ead-bff9-77f16c03bb13] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:46:10.839546 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-f2e72be6-55d2-40ea-9cd5-cba4cb8ee088 tempest-VolumesSnapshotTestJSON-1359047564 tempest-VolumesSnapshotTestJSON-1359047564-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:46:10.840185 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-f2e72be6-55d2-40ea-9cd5-cba4cb8ee088 tempest-VolumesSnapshotTestJSON-1359047564 tempest-VolumesSnapshotTestJSON-1359047564-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:46:10.841097 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-f2e72be6-55d2-40ea-9cd5-cba4cb8ee088 tempest-VolumesSnapshotTestJSON-1359047564 tempest-VolumesSnapshotTestJSON-1359047564-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:46:10.841662 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-f2e72be6-55d2-40ea-9cd5-cba4cb8ee088 tempest-VolumesSnapshotTestJSON-1359047564 tempest-VolumesSnapshotTestJSON-1359047564-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:46:11.370544 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-f2e72be6-55d2-40ea-9cd5-cba4cb8ee088 tempest-VolumesSnapshotTestJSON-1359047564 tempest-VolumesSnapshotTestJSON-1359047564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d02effcaa64a2580cdd1613e7ff1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd93c9242f08447aaa597423812d5904d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:46:11.388414 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-f2e72be6-55d2-40ea-9cd5-cba4cb8ee088 tempest-VolumesSnapshotTestJSON-1359047564 tempest-VolumesSnapshotTestJSON-1359047564-project] 10.222.0.42 "GET /compute/v2.1/servers/85116c44-42bb-4ead-bff9-77f16c03bb13" status: 200 len: 1319 microversion: 2.1 time: 0.561923 Jun 06 10:46:11.389526 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 435/851] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:46:10 2022] GET /compute/v2.1/servers/85116c44-42bb-4ead-bff9-77f16c03bb13 => generated 1319 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:46:11.930740 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [req-218126ee-f6d9-4857-891f-19e3bc6a0aac req-09c43e5d-dd0a-4236-a6ac-405b9685217e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2e2eb841-906d-4ab2-b15e-63f07cf3037d", "tag": "1efcaca9-ec5c-468f-903b-a288d6bc742f"}]} {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 10:46:11.940591 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [req-218126ee-f6d9-4857-891f-19e3bc6a0aac req-09c43e5d-dd0a-4236-a6ac-405b9685217e service nova] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:46:11.941094 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [req-218126ee-f6d9-4857-891f-19e3bc6a0aac req-09c43e5d-dd0a-4236-a6ac-405b9685217e service nova] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:46:11.953496 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.compute.server_external_events [req-218126ee-f6d9-4857-891f-19e3bc6a0aac req-09c43e5d-dd0a-4236-a6ac-405b9685217e service nova] Creating event network-changed:1efcaca9-ec5c-468f-903b-a288d6bc742f for instance 2e2eb841-906d-4ab2-b15e-63f07cf3037d on hv-cinder-84482 Jun 06 10:46:11.959399 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [req-218126ee-f6d9-4857-891f-19e3bc6a0aac req-09c43e5d-dd0a-4236-a6ac-405b9685217e service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033170 Jun 06 10:46:11.960168 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 417/852] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Jun 6 10:46:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 10:46:12.406673 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-7db04a19-f72b-45a4-a067-ec481864ce20 tempest-VolumesSnapshotTestJSON-1359047564 tempest-VolumesSnapshotTestJSON-1359047564-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:46:12.408297 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-7db04a19-f72b-45a4-a067-ec481864ce20 tempest-VolumesSnapshotTestJSON-1359047564 tempest-VolumesSnapshotTestJSON-1359047564-project] [instance: 85116c44-42bb-4ead-bff9-77f16c03bb13] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:46:12.416095 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-7db04a19-f72b-45a4-a067-ec481864ce20 tempest-VolumesSnapshotTestJSON-1359047564 tempest-VolumesSnapshotTestJSON-1359047564-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:46:12.416644 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-7db04a19-f72b-45a4-a067-ec481864ce20 tempest-VolumesSnapshotTestJSON-1359047564 tempest-VolumesSnapshotTestJSON-1359047564-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:46:12.417424 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-7db04a19-f72b-45a4-a067-ec481864ce20 tempest-VolumesSnapshotTestJSON-1359047564 tempest-VolumesSnapshotTestJSON-1359047564-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:46:12.418894 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-7db04a19-f72b-45a4-a067-ec481864ce20 tempest-VolumesSnapshotTestJSON-1359047564 tempest-VolumesSnapshotTestJSON-1359047564-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:46:12.579693 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-7db04a19-f72b-45a4-a067-ec481864ce20 tempest-VolumesSnapshotTestJSON-1359047564 tempest-VolumesSnapshotTestJSON-1359047564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d02effcaa64a2580cdd1613e7ff1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd93c9242f08447aaa597423812d5904d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:46:12.587884 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-7db04a19-f72b-45a4-a067-ec481864ce20 tempest-VolumesSnapshotTestJSON-1359047564 tempest-VolumesSnapshotTestJSON-1359047564-project] 10.222.0.42 "GET /compute/v2.1/servers/85116c44-42bb-4ead-bff9-77f16c03bb13" status: 200 len: 1319 microversion: 2.1 time: 0.185244 Jun 06 10:46:12.588470 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 436/853] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:46:12 2022] GET /compute/v2.1/servers/85116c44-42bb-4ead-bff9-77f16c03bb13 => generated 1319 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:46:13.607423 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-c94d60c9-c8bd-4e54-9fac-37c8deb17291 tempest-VolumesSnapshotTestJSON-1359047564 tempest-VolumesSnapshotTestJSON-1359047564-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:46:13.608157 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-c94d60c9-c8bd-4e54-9fac-37c8deb17291 tempest-VolumesSnapshotTestJSON-1359047564 tempest-VolumesSnapshotTestJSON-1359047564-project] [instance: 85116c44-42bb-4ead-bff9-77f16c03bb13] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:46:13.614966 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-c94d60c9-c8bd-4e54-9fac-37c8deb17291 tempest-VolumesSnapshotTestJSON-1359047564 tempest-VolumesSnapshotTestJSON-1359047564-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:46:13.615399 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-c94d60c9-c8bd-4e54-9fac-37c8deb17291 tempest-VolumesSnapshotTestJSON-1359047564 tempest-VolumesSnapshotTestJSON-1359047564-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:46:13.616195 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-c94d60c9-c8bd-4e54-9fac-37c8deb17291 tempest-VolumesSnapshotTestJSON-1359047564 tempest-VolumesSnapshotTestJSON-1359047564-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:46:13.616636 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-c94d60c9-c8bd-4e54-9fac-37c8deb17291 tempest-VolumesSnapshotTestJSON-1359047564 tempest-VolumesSnapshotTestJSON-1359047564-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:46:13.755697 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-c94d60c9-c8bd-4e54-9fac-37c8deb17291 tempest-VolumesSnapshotTestJSON-1359047564 tempest-VolumesSnapshotTestJSON-1359047564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d02effcaa64a2580cdd1613e7ff1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd93c9242f08447aaa597423812d5904d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:46:13.763549 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-c94d60c9-c8bd-4e54-9fac-37c8deb17291 tempest-VolumesSnapshotTestJSON-1359047564 tempest-VolumesSnapshotTestJSON-1359047564-project] 10.222.0.42 "GET /compute/v2.1/servers/85116c44-42bb-4ead-bff9-77f16c03bb13" status: 200 len: 1506 microversion: 2.1 time: 0.160856 Jun 06 10:46:13.764148 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 418/854] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:46:13 2022] GET /compute/v2.1/servers/85116c44-42bb-4ead-bff9-77f16c03bb13 => generated 1506 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:46:13.781342 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-a3c51e65-0fc6-44c2-aeac-d3cea00c57f7 tempest-VolumesSnapshotTestJSON-1359047564 tempest-VolumesSnapshotTestJSON-1359047564-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cf6bdacb-d0a6-4670-88d4-278f298448e8", "device": "/dev/sdb"}} {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 10:46:13.782500 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-a3c51e65-0fc6-44c2-aeac-d3cea00c57f7 tempest-VolumesSnapshotTestJSON-1359047564 tempest-VolumesSnapshotTestJSON-1359047564-project] [instance: 85116c44-42bb-4ead-bff9-77f16c03bb13] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:46:13.789221 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-a3c51e65-0fc6-44c2-aeac-d3cea00c57f7 tempest-VolumesSnapshotTestJSON-1359047564 tempest-VolumesSnapshotTestJSON-1359047564-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:46:13.789769 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-a3c51e65-0fc6-44c2-aeac-d3cea00c57f7 tempest-VolumesSnapshotTestJSON-1359047564 tempest-VolumesSnapshotTestJSON-1359047564-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:46:13.790614 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-a3c51e65-0fc6-44c2-aeac-d3cea00c57f7 tempest-VolumesSnapshotTestJSON-1359047564 tempest-VolumesSnapshotTestJSON-1359047564-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:46:13.791059 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-a3c51e65-0fc6-44c2-aeac-d3cea00c57f7 tempest-VolumesSnapshotTestJSON-1359047564 tempest-VolumesSnapshotTestJSON-1359047564-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:46:14.031726 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-a3c51e65-0fc6-44c2-aeac-d3cea00c57f7 tempest-VolumesSnapshotTestJSON-1359047564 tempest-VolumesSnapshotTestJSON-1359047564-project] 10.222.0.42 "POST /compute/v2.1/servers/85116c44-42bb-4ead-bff9-77f16c03bb13/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.254097 Jun 06 10:46:14.037494 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 437/855] 10.222.0.42 () {60 vars in 1322 bytes} [Mon Jun 6 10:46:13 2022] POST /compute/v2.1/servers/85116c44-42bb-4ead-bff9-77f16c03bb13/os-volume_attachments => generated 194 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 10:46:31.252927 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-564b47e3-d205-470d-9ba2-6feaac6d0f55 tempest-VolumesSnapshotTestJSON-1359047564 tempest-VolumesSnapshotTestJSON-1359047564-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:46:31.253468 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-564b47e3-d205-470d-9ba2-6feaac6d0f55 tempest-VolumesSnapshotTestJSON-1359047564 tempest-VolumesSnapshotTestJSON-1359047564-project] [instance: 85116c44-42bb-4ead-bff9-77f16c03bb13] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:46:31.256199 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG dbcounter [-] [129350] Writing DB stats nova_api:SELECT=31 {{(pid=129350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 10:46:31.256842 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG dbcounter [-] [129350] Writing DB stats nova_cell1:SELECT=12 {{(pid=129350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 10:46:31.262773 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-564b47e3-d205-470d-9ba2-6feaac6d0f55 tempest-VolumesSnapshotTestJSON-1359047564 tempest-VolumesSnapshotTestJSON-1359047564-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:46:31.263218 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-564b47e3-d205-470d-9ba2-6feaac6d0f55 tempest-VolumesSnapshotTestJSON-1359047564 tempest-VolumesSnapshotTestJSON-1359047564-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:46:31.264017 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-564b47e3-d205-470d-9ba2-6feaac6d0f55 tempest-VolumesSnapshotTestJSON-1359047564 tempest-VolumesSnapshotTestJSON-1359047564-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:46:31.264446 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-564b47e3-d205-470d-9ba2-6feaac6d0f55 tempest-VolumesSnapshotTestJSON-1359047564 tempest-VolumesSnapshotTestJSON-1359047564-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:46:31.340074 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.objects.instance [None req-564b47e3-d205-470d-9ba2-6feaac6d0f55 tempest-VolumesSnapshotTestJSON-1359047564 tempest-VolumesSnapshotTestJSON-1359047564-project] Lazy-loading 'services' on Instance uuid 85116c44-42bb-4ead-bff9-77f16c03bb13 {{(pid=129350) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 06 10:46:31.407523 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-564b47e3-d205-470d-9ba2-6feaac6d0f55 tempest-VolumesSnapshotTestJSON-1359047564 tempest-VolumesSnapshotTestJSON-1359047564-project] 10.222.0.42 "DELETE /compute/v2.1/servers/85116c44-42bb-4ead-bff9-77f16c03bb13/os-volume_attachments/cf6bdacb-d0a6-4670-88d4-278f298448e8" status: 202 len: 0 microversion: 2.1 time: 0.158534 Jun 06 10:46:31.408197 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 419/856] 10.222.0.42 () {58 vars in 1415 bytes} [Mon Jun 6 10:46:31 2022] DELETE /compute/v2.1/servers/85116c44-42bb-4ead-bff9-77f16c03bb13/os-volume_attachments/cf6bdacb-d0a6-4670-88d4-278f298448e8 => generated 0 bytes in 160 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 06 10:46:31.623035 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG dbcounter [-] [129349] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=3 {{(pid=129349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 10:46:31.623865 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG dbcounter [-] [129349] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 10:46:31.628730 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-5c358102-c8bd-422c-a861-66709d907aaa tempest-VolumesNegativeTest-2034797127 tempest-VolumesNegativeTest-2034797127-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-911761423", "imageRef": "6eea2d98-354d-4083-b74c-abcbb97f9e1a", "flavorRef": "452"}} {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 10:46:31.681197 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.network.neutron [None req-5c358102-c8bd-422c-a861-66709d907aaa tempest-VolumesNegativeTest-2034797127 tempest-VolumesNegativeTest-2034797127-project] validate_networks() for None {{(pid=129349) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 06 10:46:31.966108 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.virt.hardware [None req-5c358102-c8bd-422c-a861-66709d907aaa tempest-VolumesNegativeTest-2034797127 tempest-VolumesNegativeTest-2034797127-project] Flavor limits 0:0:0 {{(pid=129349) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 06 10:46:31.966530 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.virt.hardware [None req-5c358102-c8bd-422c-a861-66709d907aaa tempest-VolumesNegativeTest-2034797127 tempest-VolumesNegativeTest-2034797127-project] Image limits 0:0:0 {{(pid=129349) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 06 10:46:31.967004 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.virt.hardware [None req-5c358102-c8bd-422c-a861-66709d907aaa tempest-VolumesNegativeTest-2034797127 tempest-VolumesNegativeTest-2034797127-project] Flavor pref 0:0:0 {{(pid=129349) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 06 10:46:31.967407 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.virt.hardware [None req-5c358102-c8bd-422c-a861-66709d907aaa tempest-VolumesNegativeTest-2034797127 tempest-VolumesNegativeTest-2034797127-project] Image pref 0:0:0 {{(pid=129349) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 06 10:46:31.967838 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.virt.hardware [None req-5c358102-c8bd-422c-a861-66709d907aaa tempest-VolumesNegativeTest-2034797127 tempest-VolumesNegativeTest-2034797127-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129349) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 06 10:46:31.977875 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-5c358102-c8bd-422c-a861-66709d907aaa tempest-VolumesNegativeTest-2034797127 tempest-VolumesNegativeTest-2034797127-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:46:31.978317 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-5c358102-c8bd-422c-a861-66709d907aaa tempest-VolumesNegativeTest-2034797127 tempest-VolumesNegativeTest-2034797127-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:46:31.979113 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-5c358102-c8bd-422c-a861-66709d907aaa tempest-VolumesNegativeTest-2034797127 tempest-VolumesNegativeTest-2034797127-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:46:31.979561 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-5c358102-c8bd-422c-a861-66709d907aaa tempest-VolumesNegativeTest-2034797127 tempest-VolumesNegativeTest-2034797127-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:46:31.995736 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.quota [None req-5c358102-c8bd-422c-a861-66709d907aaa tempest-VolumesNegativeTest-2034797127 tempest-VolumesNegativeTest-2034797127-project] Getting quotas for project bce7334f1f35405d88dafe998dc5168c. Resources: {'ram', 'cores', 'instances'} {{(pid=129349) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 06 10:46:31.999728 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.quota [None req-5c358102-c8bd-422c-a861-66709d907aaa tempest-VolumesNegativeTest-2034797127 tempest-VolumesNegativeTest-2034797127-project] Getting quotas for user 37e3191be5fa4c78984a51c936268e00 and project bce7334f1f35405d88dafe998dc5168c. Resources: {'ram', 'cores', 'instances'} {{(pid=129349) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 06 10:46:32.010950 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-5c358102-c8bd-422c-a861-66709d907aaa tempest-VolumesNegativeTest-2034797127 tempest-VolumesNegativeTest-2034797127-project] Going to run 1 instances... {{(pid=129349) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 06 10:46:32.013605 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-5c358102-c8bd-422c-a861-66709d907aaa tempest-VolumesNegativeTest-2034797127 tempest-VolumesNegativeTest-2034797127-project] [instance: 6102940b-b0f0-4929-914b-8ce0e0f815fb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6eea2d98-354d-4083-b74c-abcbb97f9e1a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129349) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 06 10:46:32.057793 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-5c358102-c8bd-422c-a861-66709d907aaa tempest-VolumesNegativeTest-2034797127 tempest-VolumesNegativeTest-2034797127-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.436306 Jun 06 10:46:32.059034 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 438/857] 10.222.0.42 () {60 vars in 1146 bytes} [Mon Jun 6 10:46:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 438 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 06 10:46:32.069450 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-41ed6967-da9c-4e4a-b32b-d886d66e3acc tempest-VolumesNegativeTest-2034797127 tempest-VolumesNegativeTest-2034797127-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:46:32.070235 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-41ed6967-da9c-4e4a-b32b-d886d66e3acc tempest-VolumesNegativeTest-2034797127 tempest-VolumesNegativeTest-2034797127-project] [instance: 6102940b-b0f0-4929-914b-8ce0e0f815fb] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:46:32.128238 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-41ed6967-da9c-4e4a-b32b-d886d66e3acc tempest-VolumesNegativeTest-2034797127 tempest-VolumesNegativeTest-2034797127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e3191be5fa4c78984a51c936268e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce7334f1f35405d88dafe998dc5168c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:46:32.136967 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-41ed6967-da9c-4e4a-b32b-d886d66e3acc tempest-VolumesNegativeTest-2034797127 tempest-VolumesNegativeTest-2034797127-project] 10.222.0.42 "GET /compute/v2.1/servers/6102940b-b0f0-4929-914b-8ce0e0f815fb" status: 200 len: 1214 microversion: 2.1 time: 0.071710 Jun 06 10:46:32.137538 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 420/858] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:46:32 2022] GET /compute/v2.1/servers/6102940b-b0f0-4929-914b-8ce0e0f815fb => generated 1214 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 10:46:32.523083 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-13dc4792-f2b0-4c17-829b-944704552788 tempest-VolumesSnapshotTestJSON-1359047564 tempest-VolumesSnapshotTestJSON-1359047564-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:46:32.523586 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-13dc4792-f2b0-4c17-829b-944704552788 tempest-VolumesSnapshotTestJSON-1359047564 tempest-VolumesSnapshotTestJSON-1359047564-project] [instance: 85116c44-42bb-4ead-bff9-77f16c03bb13] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:46:32.530366 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-13dc4792-f2b0-4c17-829b-944704552788 tempest-VolumesSnapshotTestJSON-1359047564 tempest-VolumesSnapshotTestJSON-1359047564-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:46:32.530803 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-13dc4792-f2b0-4c17-829b-944704552788 tempest-VolumesSnapshotTestJSON-1359047564 tempest-VolumesSnapshotTestJSON-1359047564-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:46:32.531567 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-13dc4792-f2b0-4c17-829b-944704552788 tempest-VolumesSnapshotTestJSON-1359047564 tempest-VolumesSnapshotTestJSON-1359047564-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:46:32.532024 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-13dc4792-f2b0-4c17-829b-944704552788 tempest-VolumesSnapshotTestJSON-1359047564 tempest-VolumesSnapshotTestJSON-1359047564-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:46:32.557951 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-13dc4792-f2b0-4c17-829b-944704552788 tempest-VolumesSnapshotTestJSON-1359047564 tempest-VolumesSnapshotTestJSON-1359047564-project] [instance: 85116c44-42bb-4ead-bff9-77f16c03bb13] Going to try to terminate instance {{(pid=129349) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 06 10:46:32.633983 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-13dc4792-f2b0-4c17-829b-944704552788 tempest-VolumesSnapshotTestJSON-1359047564 tempest-VolumesSnapshotTestJSON-1359047564-project] 10.222.0.42 "DELETE /compute/v2.1/servers/85116c44-42bb-4ead-bff9-77f16c03bb13" status: 204 len: 0 microversion: 2.1 time: 0.114946 Jun 06 10:46:32.634848 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 439/859] 10.222.0.42 () {58 vars in 1238 bytes} [Mon Jun 6 10:46:32 2022] DELETE /compute/v2.1/servers/85116c44-42bb-4ead-bff9-77f16c03bb13 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 06 10:46:32.643463 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-5d2b41e4-9a2f-4d7f-a2b0-13ff0c5de401 tempest-VolumesSnapshotTestJSON-1359047564 tempest-VolumesSnapshotTestJSON-1359047564-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:46:32.644652 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-5d2b41e4-9a2f-4d7f-a2b0-13ff0c5de401 tempest-VolumesSnapshotTestJSON-1359047564 tempest-VolumesSnapshotTestJSON-1359047564-project] [instance: 85116c44-42bb-4ead-bff9-77f16c03bb13] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:46:32.652412 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-5d2b41e4-9a2f-4d7f-a2b0-13ff0c5de401 tempest-VolumesSnapshotTestJSON-1359047564 tempest-VolumesSnapshotTestJSON-1359047564-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:46:32.653095 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-5d2b41e4-9a2f-4d7f-a2b0-13ff0c5de401 tempest-VolumesSnapshotTestJSON-1359047564 tempest-VolumesSnapshotTestJSON-1359047564-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:46:32.653992 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-5d2b41e4-9a2f-4d7f-a2b0-13ff0c5de401 tempest-VolumesSnapshotTestJSON-1359047564 tempest-VolumesSnapshotTestJSON-1359047564-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:46:32.654493 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-5d2b41e4-9a2f-4d7f-a2b0-13ff0c5de401 tempest-VolumesSnapshotTestJSON-1359047564 tempest-VolumesSnapshotTestJSON-1359047564-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:46:32.790980 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-5d2b41e4-9a2f-4d7f-a2b0-13ff0c5de401 tempest-VolumesSnapshotTestJSON-1359047564 tempest-VolumesSnapshotTestJSON-1359047564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d02effcaa64a2580cdd1613e7ff1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd93c9242f08447aaa597423812d5904d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:46:32.798357 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-5d2b41e4-9a2f-4d7f-a2b0-13ff0c5de401 tempest-VolumesSnapshotTestJSON-1359047564 tempest-VolumesSnapshotTestJSON-1359047564-project] 10.222.0.42 "GET /compute/v2.1/servers/85116c44-42bb-4ead-bff9-77f16c03bb13" status: 200 len: 1512 microversion: 2.1 time: 0.159073 Jun 06 10:46:32.798909 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 421/860] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:46:32 2022] GET /compute/v2.1/servers/85116c44-42bb-4ead-bff9-77f16c03bb13 => generated 1512 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 10:46:33.155009 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-ea359192-dd23-45ce-97ae-17cfad53ace0 tempest-VolumesNegativeTest-2034797127 tempest-VolumesNegativeTest-2034797127-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:46:33.155733 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-ea359192-dd23-45ce-97ae-17cfad53ace0 tempest-VolumesNegativeTest-2034797127 tempest-VolumesNegativeTest-2034797127-project] [instance: 6102940b-b0f0-4929-914b-8ce0e0f815fb] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:46:33.161762 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-ea359192-dd23-45ce-97ae-17cfad53ace0 tempest-VolumesNegativeTest-2034797127 tempest-VolumesNegativeTest-2034797127-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:46:33.162208 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-ea359192-dd23-45ce-97ae-17cfad53ace0 tempest-VolumesNegativeTest-2034797127 tempest-VolumesNegativeTest-2034797127-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:46:33.162963 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-ea359192-dd23-45ce-97ae-17cfad53ace0 tempest-VolumesNegativeTest-2034797127 tempest-VolumesNegativeTest-2034797127-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:46:33.163392 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-ea359192-dd23-45ce-97ae-17cfad53ace0 tempest-VolumesNegativeTest-2034797127 tempest-VolumesNegativeTest-2034797127-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:46:33.227458 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-ea359192-dd23-45ce-97ae-17cfad53ace0 tempest-VolumesNegativeTest-2034797127 tempest-VolumesNegativeTest-2034797127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e3191be5fa4c78984a51c936268e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce7334f1f35405d88dafe998dc5168c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:46:33.234785 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-ea359192-dd23-45ce-97ae-17cfad53ace0 tempest-VolumesNegativeTest-2034797127 tempest-VolumesNegativeTest-2034797127-project] 10.222.0.42 "GET /compute/v2.1/servers/6102940b-b0f0-4929-914b-8ce0e0f815fb" status: 200 len: 1266 microversion: 2.1 time: 0.084007 Jun 06 10:46:33.235343 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 440/861] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:46:33 2022] GET /compute/v2.1/servers/6102940b-b0f0-4929-914b-8ce0e0f815fb => generated 1266 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:46:33.815284 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-1426c2ab-678f-488a-9fb7-63a6c86159aa tempest-VolumesSnapshotTestJSON-1359047564 tempest-VolumesSnapshotTestJSON-1359047564-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:46:33.816524 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-1426c2ab-678f-488a-9fb7-63a6c86159aa tempest-VolumesSnapshotTestJSON-1359047564 tempest-VolumesSnapshotTestJSON-1359047564-project] [instance: 85116c44-42bb-4ead-bff9-77f16c03bb13] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:46:33.822912 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-1426c2ab-678f-488a-9fb7-63a6c86159aa tempest-VolumesSnapshotTestJSON-1359047564 tempest-VolumesSnapshotTestJSON-1359047564-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:46:33.823358 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-1426c2ab-678f-488a-9fb7-63a6c86159aa tempest-VolumesSnapshotTestJSON-1359047564 tempest-VolumesSnapshotTestJSON-1359047564-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:46:33.824363 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-1426c2ab-678f-488a-9fb7-63a6c86159aa tempest-VolumesSnapshotTestJSON-1359047564 tempest-VolumesSnapshotTestJSON-1359047564-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:46:33.824799 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-1426c2ab-678f-488a-9fb7-63a6c86159aa tempest-VolumesSnapshotTestJSON-1359047564 tempest-VolumesSnapshotTestJSON-1359047564-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:46:33.955197 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-1426c2ab-678f-488a-9fb7-63a6c86159aa tempest-VolumesSnapshotTestJSON-1359047564 tempest-VolumesSnapshotTestJSON-1359047564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d02effcaa64a2580cdd1613e7ff1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd93c9242f08447aaa597423812d5904d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:46:33.963513 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-1426c2ab-678f-488a-9fb7-63a6c86159aa tempest-VolumesSnapshotTestJSON-1359047564 tempest-VolumesSnapshotTestJSON-1359047564-project] 10.222.0.42 "GET /compute/v2.1/servers/85116c44-42bb-4ead-bff9-77f16c03bb13" status: 200 len: 1512 microversion: 2.1 time: 0.152110 Jun 06 10:46:33.964106 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 422/862] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:46:33 2022] GET /compute/v2.1/servers/85116c44-42bb-4ead-bff9-77f16c03bb13 => generated 1512 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:46:34.251568 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-e2412472-084c-48af-b287-7cab07d1dd44 tempest-VolumesNegativeTest-2034797127 tempest-VolumesNegativeTest-2034797127-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:46:34.252214 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-e2412472-084c-48af-b287-7cab07d1dd44 tempest-VolumesNegativeTest-2034797127 tempest-VolumesNegativeTest-2034797127-project] [instance: 6102940b-b0f0-4929-914b-8ce0e0f815fb] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:46:34.259901 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-e2412472-084c-48af-b287-7cab07d1dd44 tempest-VolumesNegativeTest-2034797127 tempest-VolumesNegativeTest-2034797127-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:46:34.260344 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-e2412472-084c-48af-b287-7cab07d1dd44 tempest-VolumesNegativeTest-2034797127 tempest-VolumesNegativeTest-2034797127-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:46:34.261103 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-e2412472-084c-48af-b287-7cab07d1dd44 tempest-VolumesNegativeTest-2034797127 tempest-VolumesNegativeTest-2034797127-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:46:34.261533 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-e2412472-084c-48af-b287-7cab07d1dd44 tempest-VolumesNegativeTest-2034797127 tempest-VolumesNegativeTest-2034797127-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:46:34.325809 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-e2412472-084c-48af-b287-7cab07d1dd44 tempest-VolumesNegativeTest-2034797127 tempest-VolumesNegativeTest-2034797127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e3191be5fa4c78984a51c936268e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce7334f1f35405d88dafe998dc5168c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:46:34.334056 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-e2412472-084c-48af-b287-7cab07d1dd44 tempest-VolumesNegativeTest-2034797127 tempest-VolumesNegativeTest-2034797127-project] 10.222.0.42 "GET /compute/v2.1/servers/6102940b-b0f0-4929-914b-8ce0e0f815fb" status: 200 len: 1266 microversion: 2.1 time: 0.086338 Jun 06 10:46:34.334612 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 441/863] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:46:34 2022] GET /compute/v2.1/servers/6102940b-b0f0-4929-914b-8ce0e0f815fb => generated 1266 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:46:34.962590 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [req-c3b4dc18-6d11-4cf5-93d3-eb614df8bf39 req-332c76f1-b100-4e11-9d34-fff122d507ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85116c44-42bb-4ead-bff9-77f16c03bb13", "name": "network-vif-deleted", "tag": "02dcf782-d6e1-4f3a-a444-37498d1ac5d9"}]} {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 10:46:34.972835 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [req-c3b4dc18-6d11-4cf5-93d3-eb614df8bf39 req-332c76f1-b100-4e11-9d34-fff122d507ae service nova] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:46:34.973290 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [req-c3b4dc18-6d11-4cf5-93d3-eb614df8bf39 req-332c76f1-b100-4e11-9d34-fff122d507ae service nova] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:46:34.980804 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-706f5b93-96c1-4703-97ae-04756b532135 tempest-VolumesSnapshotTestJSON-1359047564 tempest-VolumesSnapshotTestJSON-1359047564-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:46:34.981662 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-706f5b93-96c1-4703-97ae-04756b532135 tempest-VolumesSnapshotTestJSON-1359047564 tempest-VolumesSnapshotTestJSON-1359047564-project] [instance: 85116c44-42bb-4ead-bff9-77f16c03bb13] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:46:34.988163 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-706f5b93-96c1-4703-97ae-04756b532135 tempest-VolumesSnapshotTestJSON-1359047564 tempest-VolumesSnapshotTestJSON-1359047564-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:46:34.988900 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-706f5b93-96c1-4703-97ae-04756b532135 tempest-VolumesSnapshotTestJSON-1359047564 tempest-VolumesSnapshotTestJSON-1359047564-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:46:34.989854 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-706f5b93-96c1-4703-97ae-04756b532135 tempest-VolumesSnapshotTestJSON-1359047564 tempest-VolumesSnapshotTestJSON-1359047564-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:46:34.990229 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.compute.server_external_events [req-c3b4dc18-6d11-4cf5-93d3-eb614df8bf39 req-332c76f1-b100-4e11-9d34-fff122d507ae service nova] Creating event network-vif-deleted:02dcf782-d6e1-4f3a-a444-37498d1ac5d9 for instance 85116c44-42bb-4ead-bff9-77f16c03bb13 on hv-cinder-84482 Jun 06 10:46:34.990539 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-706f5b93-96c1-4703-97ae-04756b532135 tempest-VolumesSnapshotTestJSON-1359047564 tempest-VolumesSnapshotTestJSON-1359047564-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:46:34.997131 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [req-c3b4dc18-6d11-4cf5-93d3-eb614df8bf39 req-332c76f1-b100-4e11-9d34-fff122d507ae service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039016 Jun 06 10:46:34.997745 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 423/864] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Jun 6 10:46:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 10:46:35.078335 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-706f5b93-96c1-4703-97ae-04756b532135 tempest-VolumesSnapshotTestJSON-1359047564 tempest-VolumesSnapshotTestJSON-1359047564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d02effcaa64a2580cdd1613e7ff1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd93c9242f08447aaa597423812d5904d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:46:35.088743 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-706f5b93-96c1-4703-97ae-04756b532135 tempest-VolumesSnapshotTestJSON-1359047564 tempest-VolumesSnapshotTestJSON-1359047564-project] 10.222.0.42 "GET /compute/v2.1/servers/85116c44-42bb-4ead-bff9-77f16c03bb13" status: 200 len: 1304 microversion: 2.1 time: 0.111413 Jun 06 10:46:35.089571 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 442/865] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:46:34 2022] GET /compute/v2.1/servers/85116c44-42bb-4ead-bff9-77f16c03bb13 => generated 1304 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 10:46:35.351890 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-534f2fe7-46ba-44c7-90a2-669d7546783a tempest-VolumesNegativeTest-2034797127 tempest-VolumesNegativeTest-2034797127-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:46:35.352802 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-534f2fe7-46ba-44c7-90a2-669d7546783a tempest-VolumesNegativeTest-2034797127 tempest-VolumesNegativeTest-2034797127-project] [instance: 6102940b-b0f0-4929-914b-8ce0e0f815fb] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:46:35.360177 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-534f2fe7-46ba-44c7-90a2-669d7546783a tempest-VolumesNegativeTest-2034797127 tempest-VolumesNegativeTest-2034797127-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:46:35.362090 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-534f2fe7-46ba-44c7-90a2-669d7546783a tempest-VolumesNegativeTest-2034797127 tempest-VolumesNegativeTest-2034797127-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:46:35.362090 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-534f2fe7-46ba-44c7-90a2-669d7546783a tempest-VolumesNegativeTest-2034797127 tempest-VolumesNegativeTest-2034797127-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:46:35.363399 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-534f2fe7-46ba-44c7-90a2-669d7546783a tempest-VolumesNegativeTest-2034797127 tempest-VolumesNegativeTest-2034797127-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:46:35.530006 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-534f2fe7-46ba-44c7-90a2-669d7546783a tempest-VolumesNegativeTest-2034797127 tempest-VolumesNegativeTest-2034797127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e3191be5fa4c78984a51c936268e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce7334f1f35405d88dafe998dc5168c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:46:35.538112 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-534f2fe7-46ba-44c7-90a2-669d7546783a tempest-VolumesNegativeTest-2034797127 tempest-VolumesNegativeTest-2034797127-project] 10.222.0.42 "GET /compute/v2.1/servers/6102940b-b0f0-4929-914b-8ce0e0f815fb" status: 200 len: 1314 microversion: 2.1 time: 0.190799 Jun 06 10:46:35.539004 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 424/866] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:46:35 2022] GET /compute/v2.1/servers/6102940b-b0f0-4929-914b-8ce0e0f815fb => generated 1314 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:46:36.107595 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-d9e6b9ca-bd80-4135-86df-899e242fb82c tempest-VolumesSnapshotTestJSON-1359047564 tempest-VolumesSnapshotTestJSON-1359047564-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:46:36.108996 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-d9e6b9ca-bd80-4135-86df-899e242fb82c tempest-VolumesSnapshotTestJSON-1359047564 tempest-VolumesSnapshotTestJSON-1359047564-project] [instance: 85116c44-42bb-4ead-bff9-77f16c03bb13] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:46:36.117716 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-d9e6b9ca-bd80-4135-86df-899e242fb82c tempest-VolumesSnapshotTestJSON-1359047564 tempest-VolumesSnapshotTestJSON-1359047564-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:46:36.118296 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-d9e6b9ca-bd80-4135-86df-899e242fb82c tempest-VolumesSnapshotTestJSON-1359047564 tempest-VolumesSnapshotTestJSON-1359047564-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:46:36.119271 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-d9e6b9ca-bd80-4135-86df-899e242fb82c tempest-VolumesSnapshotTestJSON-1359047564 tempest-VolumesSnapshotTestJSON-1359047564-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:46:36.119843 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-d9e6b9ca-bd80-4135-86df-899e242fb82c tempest-VolumesSnapshotTestJSON-1359047564 tempest-VolumesSnapshotTestJSON-1359047564-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:46:36.134552 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.wsgi [None req-d9e6b9ca-bd80-4135-86df-899e242fb82c tempest-VolumesSnapshotTestJSON-1359047564 tempest-VolumesSnapshotTestJSON-1359047564-project] HTTP exception thrown: Instance 85116c44-42bb-4ead-bff9-77f16c03bb13 could not be found. Jun 06 10:46:36.136393 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-d9e6b9ca-bd80-4135-86df-899e242fb82c tempest-VolumesSnapshotTestJSON-1359047564 tempest-VolumesSnapshotTestJSON-1359047564-project] Request method failure captured: Jun 06 10:46:36.136393 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: request: GET /compute/v2.1/servers/85116c44-42bb-4ead-bff9-77f16c03bb13 HTTP/1.1 Jun 06 10:46:36.136393 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: Accept: application/json Jun 06 10:46:36.136393 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: Accept-Encoding: identity Jun 06 10:46:36.136393 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: Connection: close Jun 06 10:46:36.136393 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: Content-Length: 0 Jun 06 10:46:36.136393 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: Content-Type: application/json Jun 06 10:46:36.136393 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: Host: 10.222.0.42 Jun 06 10:46:36.136393 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: Openstack-System-Scope: None Jun 06 10:46:36.136393 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: User-Agent: python-urllib3/1.26.9 Jun 06 10:46:36.136393 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Auth-Token: gAAAAABindqoXjnBYEmeNLehgVGxM5jjKXhFQu7eZsCkpKEjEZoMMtheu0rIqETZepsQ9SYYCvP87bFuScGJS_0T1VZ0WudlhQchKL0ezQfaE5CBqpDYcKPxJJQW2SivbiTpPJ6CncqtBjbdNfoQ5-w6GYMJHBanqQirV442GW70AhaD5rQZrSs Jun 06 10:46:36.136393 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Domain-Id: None Jun 06 10:46:36.136393 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Domain-Name: None Jun 06 10:46:36.136393 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Identity-Status: Confirmed Jun 06 10:46:36.136393 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Is-Admin-Project: True Jun 06 10:46:36.136393 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Project-Domain-Id: default Jun 06 10:46:36.136393 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Project-Domain-Name: Default Jun 06 10:46:36.136393 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Project-Id: d93c9242f08447aaa597423812d5904d Jun 06 10:46:36.136393 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1359047564 Jun 06 10:46:36.136393 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Role: member,reader Jun 06 10:46:36.136393 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Roles: member,reader Jun 06 10:46:36.138366 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/d93c9242f08447aaa597423812d5904d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/d93c9242f08447aaa597423812d5904d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/d93c9242f08447aaa597423812d5904d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_d93c9242f08447aaa597423812d5904d", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Jun 06 10:46:36.138366 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Tenant: tempest-VolumesSnapshotTestJSON-1359047564 Jun 06 10:46:36.138366 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Tenant-Id: d93c9242f08447aaa597423812d5904d Jun 06 10:46:36.138366 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1359047564 Jun 06 10:46:36.138366 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-User: tempest-VolumesSnapshotTestJSON-1359047564-project Jun 06 10:46:36.138366 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-User-Domain-Id: default Jun 06 10:46:36.138366 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-User-Domain-Name: Default Jun 06 10:46:36.138366 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-User-Id: 63d02effcaa64a2580cdd1613e7ff1d8 Jun 06 10:46:36.138366 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-User-Name: tempest-VolumesSnapshotTestJSON-1359047564-project Jun 06 10:46:36.138366 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: method: > Jun 06 10:46:36.138366 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: exception: Instance 85116c44-42bb-4ead-bff9-77f16c03bb13 could not be found. Jun 06 10:46:36.138366 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: action_args: {'id': '85116c44-42bb-4ead-bff9-77f16c03bb13'} Jun 06 10:46:36.139398 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 10:46:36.139398 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 10:46:36.139398 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 06 10:46:36.139398 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 06 10:46:36.139398 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 06 10:46:36.139398 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 06 10:46:36.139398 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 06 10:46:36.139398 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 06 10:46:36.139398 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 06 10:46:36.139398 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 06 10:46:36.139398 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 85116c44-42bb-4ead-bff9-77f16c03bb13 could not be found. Jun 06 10:46:36.139398 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Jun 06 10:46:36.139398 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 10:46:36.139398 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Jun 06 10:46:36.139398 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 10:46:36.139398 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 10:46:36.139398 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 10:46:36.139398 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 10:46:36.139398 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 10:46:36.139398 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 10:46:36.141141 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 10:46:36.141141 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 06 10:46:36.141141 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 06 10:46:36.141141 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 06 10:46:36.141141 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 06 10:46:36.141141 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 06 10:46:36.141141 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 06 10:46:36.141141 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 85116c44-42bb-4ead-bff9-77f16c03bb13 could not be found. Jun 06 10:46:36.141141 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Jun 06 10:46:36.141141 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 10:46:36.141141 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Jun 06 10:46:36.141141 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 10:46:36.141141 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 10:46:36.141141 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 10:46:36.141141 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 10:46:36.141141 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 10:46:36.141141 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 85116c44-42bb-4ead-bff9-77f16c03bb13 could not be found. Jun 06 10:46:36.141141 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Jun 06 10:46:36.146107 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-d9e6b9ca-bd80-4135-86df-899e242fb82c tempest-VolumesSnapshotTestJSON-1359047564 tempest-VolumesSnapshotTestJSON-1359047564-project] Returning 404 to user: Instance 85116c44-42bb-4ead-bff9-77f16c03bb13 could not be found. {{(pid=129349) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 10:46:36.146107 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-d9e6b9ca-bd80-4135-86df-899e242fb82c tempest-VolumesSnapshotTestJSON-1359047564 tempest-VolumesSnapshotTestJSON-1359047564-project] 10.222.0.42 "GET /compute/v2.1/servers/85116c44-42bb-4ead-bff9-77f16c03bb13" status: 404 len: 111 microversion: 2.1 time: 0.038248 Jun 06 10:46:36.146107 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 443/867] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:46:36 2022] GET /compute/v2.1/servers/85116c44-42bb-4ead-bff9-77f16c03bb13 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 06 10:46:36.327928 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [req-877bfb6d-825b-475d-9cd5-ce8972305467 req-0c820f7a-5d56-4b01-a6d8-ed98a22c0322 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6102940b-b0f0-4929-914b-8ce0e0f815fb", "tag": "6cc3dc2f-30db-4280-b3e9-60794583cc04"}]} {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 10:46:36.341366 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [req-877bfb6d-825b-475d-9cd5-ce8972305467 req-0c820f7a-5d56-4b01-a6d8-ed98a22c0322 service nova] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:46:36.342378 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [req-877bfb6d-825b-475d-9cd5-ce8972305467 req-0c820f7a-5d56-4b01-a6d8-ed98a22c0322 service nova] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:46:36.370074 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.compute.server_external_events [req-877bfb6d-825b-475d-9cd5-ce8972305467 req-0c820f7a-5d56-4b01-a6d8-ed98a22c0322 service nova] Creating event network-changed:6cc3dc2f-30db-4280-b3e9-60794583cc04 for instance 6102940b-b0f0-4929-914b-8ce0e0f815fb on hv-cinder-84482 Jun 06 10:46:36.377303 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [req-877bfb6d-825b-475d-9cd5-ce8972305467 req-0c820f7a-5d56-4b01-a6d8-ed98a22c0322 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054060 Jun 06 10:46:36.378879 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 425/868] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Jun 6 10:46:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 10:46:36.554526 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-41d2b840-2a44-4e01-a647-562352bf95b7 tempest-VolumesNegativeTest-2034797127 tempest-VolumesNegativeTest-2034797127-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:46:36.555144 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-41d2b840-2a44-4e01-a647-562352bf95b7 tempest-VolumesNegativeTest-2034797127 tempest-VolumesNegativeTest-2034797127-project] [instance: 6102940b-b0f0-4929-914b-8ce0e0f815fb] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:46:36.561439 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-41d2b840-2a44-4e01-a647-562352bf95b7 tempest-VolumesNegativeTest-2034797127 tempest-VolumesNegativeTest-2034797127-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:46:36.561891 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-41d2b840-2a44-4e01-a647-562352bf95b7 tempest-VolumesNegativeTest-2034797127 tempest-VolumesNegativeTest-2034797127-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:46:36.562670 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-41d2b840-2a44-4e01-a647-562352bf95b7 tempest-VolumesNegativeTest-2034797127 tempest-VolumesNegativeTest-2034797127-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:46:36.563110 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-41d2b840-2a44-4e01-a647-562352bf95b7 tempest-VolumesNegativeTest-2034797127 tempest-VolumesNegativeTest-2034797127-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:46:36.705914 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-41d2b840-2a44-4e01-a647-562352bf95b7 tempest-VolumesNegativeTest-2034797127 tempest-VolumesNegativeTest-2034797127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e3191be5fa4c78984a51c936268e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce7334f1f35405d88dafe998dc5168c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:46:36.714141 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-41d2b840-2a44-4e01-a647-562352bf95b7 tempest-VolumesNegativeTest-2034797127 tempest-VolumesNegativeTest-2034797127-project] 10.222.0.42 "GET /compute/v2.1/servers/6102940b-b0f0-4929-914b-8ce0e0f815fb" status: 200 len: 1314 microversion: 2.1 time: 0.163521 Jun 06 10:46:36.714707 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 444/869] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:46:36 2022] GET /compute/v2.1/servers/6102940b-b0f0-4929-914b-8ce0e0f815fb => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:46:37.732923 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-b1ae21a3-1a6d-4876-845d-bb5158655260 tempest-VolumesNegativeTest-2034797127 tempest-VolumesNegativeTest-2034797127-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:46:37.733674 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-b1ae21a3-1a6d-4876-845d-bb5158655260 tempest-VolumesNegativeTest-2034797127 tempest-VolumesNegativeTest-2034797127-project] [instance: 6102940b-b0f0-4929-914b-8ce0e0f815fb] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:46:37.740941 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-b1ae21a3-1a6d-4876-845d-bb5158655260 tempest-VolumesNegativeTest-2034797127 tempest-VolumesNegativeTest-2034797127-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:46:37.741396 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-b1ae21a3-1a6d-4876-845d-bb5158655260 tempest-VolumesNegativeTest-2034797127 tempest-VolumesNegativeTest-2034797127-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:46:37.742215 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-b1ae21a3-1a6d-4876-845d-bb5158655260 tempest-VolumesNegativeTest-2034797127 tempest-VolumesNegativeTest-2034797127-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:46:37.742673 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-b1ae21a3-1a6d-4876-845d-bb5158655260 tempest-VolumesNegativeTest-2034797127 tempest-VolumesNegativeTest-2034797127-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:46:37.874806 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-b1ae21a3-1a6d-4876-845d-bb5158655260 tempest-VolumesNegativeTest-2034797127 tempest-VolumesNegativeTest-2034797127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e3191be5fa4c78984a51c936268e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce7334f1f35405d88dafe998dc5168c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:46:37.882777 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-b1ae21a3-1a6d-4876-845d-bb5158655260 tempest-VolumesNegativeTest-2034797127 tempest-VolumesNegativeTest-2034797127-project] 10.222.0.42 "GET /compute/v2.1/servers/6102940b-b0f0-4929-914b-8ce0e0f815fb" status: 200 len: 1314 microversion: 2.1 time: 0.154939 Jun 06 10:46:37.883332 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 426/870] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:46:37 2022] GET /compute/v2.1/servers/6102940b-b0f0-4929-914b-8ce0e0f815fb => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 10:46:38.900179 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-afac94be-ab83-4319-a105-a6f7af88ef9d tempest-VolumesNegativeTest-2034797127 tempest-VolumesNegativeTest-2034797127-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:46:38.900770 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-afac94be-ab83-4319-a105-a6f7af88ef9d tempest-VolumesNegativeTest-2034797127 tempest-VolumesNegativeTest-2034797127-project] [instance: 6102940b-b0f0-4929-914b-8ce0e0f815fb] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:46:38.907180 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-afac94be-ab83-4319-a105-a6f7af88ef9d tempest-VolumesNegativeTest-2034797127 tempest-VolumesNegativeTest-2034797127-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:46:38.907620 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-afac94be-ab83-4319-a105-a6f7af88ef9d tempest-VolumesNegativeTest-2034797127 tempest-VolumesNegativeTest-2034797127-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:46:38.908402 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-afac94be-ab83-4319-a105-a6f7af88ef9d tempest-VolumesNegativeTest-2034797127 tempest-VolumesNegativeTest-2034797127-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:46:38.908832 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-afac94be-ab83-4319-a105-a6f7af88ef9d tempest-VolumesNegativeTest-2034797127 tempest-VolumesNegativeTest-2034797127-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:46:39.036190 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-afac94be-ab83-4319-a105-a6f7af88ef9d tempest-VolumesNegativeTest-2034797127 tempest-VolumesNegativeTest-2034797127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e3191be5fa4c78984a51c936268e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce7334f1f35405d88dafe998dc5168c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:46:39.043679 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-afac94be-ab83-4319-a105-a6f7af88ef9d tempest-VolumesNegativeTest-2034797127 tempest-VolumesNegativeTest-2034797127-project] 10.222.0.42 "GET /compute/v2.1/servers/6102940b-b0f0-4929-914b-8ce0e0f815fb" status: 200 len: 1314 microversion: 2.1 time: 0.147367 Jun 06 10:46:39.044253 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 445/871] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:46:38 2022] GET /compute/v2.1/servers/6102940b-b0f0-4929-914b-8ce0e0f815fb => generated 1314 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:46:40.060679 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-0199faa7-eed9-4370-b964-a8f6106a9343 tempest-VolumesNegativeTest-2034797127 tempest-VolumesNegativeTest-2034797127-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:46:40.061218 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-0199faa7-eed9-4370-b964-a8f6106a9343 tempest-VolumesNegativeTest-2034797127 tempest-VolumesNegativeTest-2034797127-project] [instance: 6102940b-b0f0-4929-914b-8ce0e0f815fb] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:46:40.067615 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-0199faa7-eed9-4370-b964-a8f6106a9343 tempest-VolumesNegativeTest-2034797127 tempest-VolumesNegativeTest-2034797127-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:46:40.068096 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-0199faa7-eed9-4370-b964-a8f6106a9343 tempest-VolumesNegativeTest-2034797127 tempest-VolumesNegativeTest-2034797127-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:46:40.068853 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-0199faa7-eed9-4370-b964-a8f6106a9343 tempest-VolumesNegativeTest-2034797127 tempest-VolumesNegativeTest-2034797127-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:46:40.069288 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-0199faa7-eed9-4370-b964-a8f6106a9343 tempest-VolumesNegativeTest-2034797127 tempest-VolumesNegativeTest-2034797127-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:46:40.199186 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-0199faa7-eed9-4370-b964-a8f6106a9343 tempest-VolumesNegativeTest-2034797127 tempest-VolumesNegativeTest-2034797127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e3191be5fa4c78984a51c936268e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce7334f1f35405d88dafe998dc5168c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:46:40.207171 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-0199faa7-eed9-4370-b964-a8f6106a9343 tempest-VolumesNegativeTest-2034797127 tempest-VolumesNegativeTest-2034797127-project] 10.222.0.42 "GET /compute/v2.1/servers/6102940b-b0f0-4929-914b-8ce0e0f815fb" status: 200 len: 1314 microversion: 2.1 time: 0.150498 Jun 06 10:46:40.207729 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 427/872] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:46:40 2022] GET /compute/v2.1/servers/6102940b-b0f0-4929-914b-8ce0e0f815fb => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:46:41.223658 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-0374145b-d6d3-4405-8c0c-7071cc64a480 tempest-VolumesNegativeTest-2034797127 tempest-VolumesNegativeTest-2034797127-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:46:41.224296 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-0374145b-d6d3-4405-8c0c-7071cc64a480 tempest-VolumesNegativeTest-2034797127 tempest-VolumesNegativeTest-2034797127-project] [instance: 6102940b-b0f0-4929-914b-8ce0e0f815fb] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:46:41.230766 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-0374145b-d6d3-4405-8c0c-7071cc64a480 tempest-VolumesNegativeTest-2034797127 tempest-VolumesNegativeTest-2034797127-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:46:41.231204 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-0374145b-d6d3-4405-8c0c-7071cc64a480 tempest-VolumesNegativeTest-2034797127 tempest-VolumesNegativeTest-2034797127-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:46:41.231995 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-0374145b-d6d3-4405-8c0c-7071cc64a480 tempest-VolumesNegativeTest-2034797127 tempest-VolumesNegativeTest-2034797127-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:46:41.232423 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-0374145b-d6d3-4405-8c0c-7071cc64a480 tempest-VolumesNegativeTest-2034797127 tempest-VolumesNegativeTest-2034797127-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:46:41.378973 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-0374145b-d6d3-4405-8c0c-7071cc64a480 tempest-VolumesNegativeTest-2034797127 tempest-VolumesNegativeTest-2034797127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e3191be5fa4c78984a51c936268e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce7334f1f35405d88dafe998dc5168c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:46:41.386780 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-0374145b-d6d3-4405-8c0c-7071cc64a480 tempest-VolumesNegativeTest-2034797127 tempest-VolumesNegativeTest-2034797127-project] 10.222.0.42 "GET /compute/v2.1/servers/6102940b-b0f0-4929-914b-8ce0e0f815fb" status: 200 len: 1314 microversion: 2.1 time: 0.166970 Jun 06 10:46:41.387340 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 446/873] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:46:41 2022] GET /compute/v2.1/servers/6102940b-b0f0-4929-914b-8ce0e0f815fb => generated 1314 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:46:42.406420 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-192a7c25-c158-453c-82e6-c735312bf6a1 tempest-VolumesNegativeTest-2034797127 tempest-VolumesNegativeTest-2034797127-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:46:42.407102 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-192a7c25-c158-453c-82e6-c735312bf6a1 tempest-VolumesNegativeTest-2034797127 tempest-VolumesNegativeTest-2034797127-project] [instance: 6102940b-b0f0-4929-914b-8ce0e0f815fb] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:46:42.410373 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG dbcounter [-] [129350] Writing DB stats nova_cell0:SELECT=2 {{(pid=129350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 10:46:42.416029 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-192a7c25-c158-453c-82e6-c735312bf6a1 tempest-VolumesNegativeTest-2034797127 tempest-VolumesNegativeTest-2034797127-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:46:42.416546 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-192a7c25-c158-453c-82e6-c735312bf6a1 tempest-VolumesNegativeTest-2034797127 tempest-VolumesNegativeTest-2034797127-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:46:42.417418 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-192a7c25-c158-453c-82e6-c735312bf6a1 tempest-VolumesNegativeTest-2034797127 tempest-VolumesNegativeTest-2034797127-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:46:42.417945 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-192a7c25-c158-453c-82e6-c735312bf6a1 tempest-VolumesNegativeTest-2034797127 tempest-VolumesNegativeTest-2034797127-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:46:42.550763 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-192a7c25-c158-453c-82e6-c735312bf6a1 tempest-VolumesNegativeTest-2034797127 tempest-VolumesNegativeTest-2034797127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e3191be5fa4c78984a51c936268e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce7334f1f35405d88dafe998dc5168c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:46:42.558552 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-192a7c25-c158-453c-82e6-c735312bf6a1 tempest-VolumesNegativeTest-2034797127 tempest-VolumesNegativeTest-2034797127-project] 10.222.0.42 "GET /compute/v2.1/servers/6102940b-b0f0-4929-914b-8ce0e0f815fb" status: 200 len: 1314 microversion: 2.1 time: 0.157117 Jun 06 10:46:42.559349 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 428/874] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:46:42 2022] GET /compute/v2.1/servers/6102940b-b0f0-4929-914b-8ce0e0f815fb => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:46:42.766860 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [req-4465644d-35b6-4439-a38e-4fa25a44c5c7 req-7427c98e-f141-4e90-ae31-f46b3bb337ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6102940b-b0f0-4929-914b-8ce0e0f815fb", "name": "network-vif-plugged", "status": "completed", "tag": "6cc3dc2f-30db-4280-b3e9-60794583cc04"}]} {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 10:46:42.770733 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG dbcounter [-] [129349] Writing DB stats nova_cell0:SELECT=2 {{(pid=129349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 10:46:42.771387 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG dbcounter [-] [129349] Writing DB stats nova_cell0:SELECT=6 {{(pid=129349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 10:46:42.777956 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [req-4465644d-35b6-4439-a38e-4fa25a44c5c7 req-7427c98e-f141-4e90-ae31-f46b3bb337ae service nova] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:46:42.778393 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [req-4465644d-35b6-4439-a38e-4fa25a44c5c7 req-7427c98e-f141-4e90-ae31-f46b3bb337ae service nova] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:46:42.790081 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.compute.server_external_events [req-4465644d-35b6-4439-a38e-4fa25a44c5c7 req-7427c98e-f141-4e90-ae31-f46b3bb337ae service nova] Creating event network-vif-plugged:6cc3dc2f-30db-4280-b3e9-60794583cc04 for instance 6102940b-b0f0-4929-914b-8ce0e0f815fb on hv-cinder-84482 Jun 06 10:46:42.794895 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [req-4465644d-35b6-4439-a38e-4fa25a44c5c7 req-7427c98e-f141-4e90-ae31-f46b3bb337ae service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031763 Jun 06 10:46:42.795471 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 447/875] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Jun 6 10:46:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 10:46:43.577181 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-b7f49b89-5c92-46ef-aba2-d42cae2419ab tempest-VolumesNegativeTest-2034797127 tempest-VolumesNegativeTest-2034797127-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:46:43.577765 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-b7f49b89-5c92-46ef-aba2-d42cae2419ab tempest-VolumesNegativeTest-2034797127 tempest-VolumesNegativeTest-2034797127-project] [instance: 6102940b-b0f0-4929-914b-8ce0e0f815fb] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:46:43.585094 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-b7f49b89-5c92-46ef-aba2-d42cae2419ab tempest-VolumesNegativeTest-2034797127 tempest-VolumesNegativeTest-2034797127-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:46:43.585571 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-b7f49b89-5c92-46ef-aba2-d42cae2419ab tempest-VolumesNegativeTest-2034797127 tempest-VolumesNegativeTest-2034797127-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:46:43.586543 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-b7f49b89-5c92-46ef-aba2-d42cae2419ab tempest-VolumesNegativeTest-2034797127 tempest-VolumesNegativeTest-2034797127-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:46:43.587167 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-b7f49b89-5c92-46ef-aba2-d42cae2419ab tempest-VolumesNegativeTest-2034797127 tempest-VolumesNegativeTest-2034797127-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:46:43.720414 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-b7f49b89-5c92-46ef-aba2-d42cae2419ab tempest-VolumesNegativeTest-2034797127 tempest-VolumesNegativeTest-2034797127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e3191be5fa4c78984a51c936268e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce7334f1f35405d88dafe998dc5168c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:46:43.727729 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-b7f49b89-5c92-46ef-aba2-d42cae2419ab tempest-VolumesNegativeTest-2034797127 tempest-VolumesNegativeTest-2034797127-project] 10.222.0.42 "GET /compute/v2.1/servers/6102940b-b0f0-4929-914b-8ce0e0f815fb" status: 200 len: 1314 microversion: 2.1 time: 0.155696 Jun 06 10:46:43.728337 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 429/876] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:46:43 2022] GET /compute/v2.1/servers/6102940b-b0f0-4929-914b-8ce0e0f815fb => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:46:44.745804 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-14b6c2d4-7a6e-42e2-830d-83ebcf596f62 tempest-VolumesNegativeTest-2034797127 tempest-VolumesNegativeTest-2034797127-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:46:44.746601 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-14b6c2d4-7a6e-42e2-830d-83ebcf596f62 tempest-VolumesNegativeTest-2034797127 tempest-VolumesNegativeTest-2034797127-project] [instance: 6102940b-b0f0-4929-914b-8ce0e0f815fb] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:46:44.753390 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-14b6c2d4-7a6e-42e2-830d-83ebcf596f62 tempest-VolumesNegativeTest-2034797127 tempest-VolumesNegativeTest-2034797127-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:46:44.753839 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-14b6c2d4-7a6e-42e2-830d-83ebcf596f62 tempest-VolumesNegativeTest-2034797127 tempest-VolumesNegativeTest-2034797127-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:46:44.754612 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-14b6c2d4-7a6e-42e2-830d-83ebcf596f62 tempest-VolumesNegativeTest-2034797127 tempest-VolumesNegativeTest-2034797127-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:46:44.755048 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-14b6c2d4-7a6e-42e2-830d-83ebcf596f62 tempest-VolumesNegativeTest-2034797127 tempest-VolumesNegativeTest-2034797127-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:46:44.899258 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-14b6c2d4-7a6e-42e2-830d-83ebcf596f62 tempest-VolumesNegativeTest-2034797127 tempest-VolumesNegativeTest-2034797127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e3191be5fa4c78984a51c936268e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce7334f1f35405d88dafe998dc5168c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:46:44.906768 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-14b6c2d4-7a6e-42e2-830d-83ebcf596f62 tempest-VolumesNegativeTest-2034797127 tempest-VolumesNegativeTest-2034797127-project] 10.222.0.42 "GET /compute/v2.1/servers/6102940b-b0f0-4929-914b-8ce0e0f815fb" status: 200 len: 1464 microversion: 2.1 time: 0.165744 Jun 06 10:46:44.907329 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 448/877] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:46:44 2022] GET /compute/v2.1/servers/6102940b-b0f0-4929-914b-8ce0e0f815fb => generated 1464 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 10:46:44.946535 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-796f2713-061e-47de-9f15-855eceb4e230 tempest-VolumesNegativeTest-2034797127 tempest-VolumesNegativeTest-2034797127-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:46:44.946921 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-796f2713-061e-47de-9f15-855eceb4e230 tempest-VolumesNegativeTest-2034797127 tempest-VolumesNegativeTest-2034797127-project] [instance: 6102940b-b0f0-4929-914b-8ce0e0f815fb] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:46:44.952934 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-796f2713-061e-47de-9f15-855eceb4e230 tempest-VolumesNegativeTest-2034797127 tempest-VolumesNegativeTest-2034797127-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:46:44.953387 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-796f2713-061e-47de-9f15-855eceb4e230 tempest-VolumesNegativeTest-2034797127 tempest-VolumesNegativeTest-2034797127-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:46:44.954181 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-796f2713-061e-47de-9f15-855eceb4e230 tempest-VolumesNegativeTest-2034797127 tempest-VolumesNegativeTest-2034797127-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:46:44.954626 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-796f2713-061e-47de-9f15-855eceb4e230 tempest-VolumesNegativeTest-2034797127 tempest-VolumesNegativeTest-2034797127-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:46:44.979432 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-796f2713-061e-47de-9f15-855eceb4e230 tempest-VolumesNegativeTest-2034797127 tempest-VolumesNegativeTest-2034797127-project] [instance: 6102940b-b0f0-4929-914b-8ce0e0f815fb] Going to try to terminate instance {{(pid=129350) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 06 10:46:45.055040 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-796f2713-061e-47de-9f15-855eceb4e230 tempest-VolumesNegativeTest-2034797127 tempest-VolumesNegativeTest-2034797127-project] 10.222.0.42 "DELETE /compute/v2.1/servers/6102940b-b0f0-4929-914b-8ce0e0f815fb" status: 204 len: 0 microversion: 2.1 time: 0.111928 Jun 06 10:46:45.055736 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 430/878] 10.222.0.42 () {58 vars in 1238 bytes} [Mon Jun 6 10:46:44 2022] DELETE /compute/v2.1/servers/6102940b-b0f0-4929-914b-8ce0e0f815fb => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 06 10:46:45.064428 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-5a89526e-1b62-43d6-908f-bcbb8a521021 tempest-VolumesNegativeTest-2034797127 tempest-VolumesNegativeTest-2034797127-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:46:45.065055 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-5a89526e-1b62-43d6-908f-bcbb8a521021 tempest-VolumesNegativeTest-2034797127 tempest-VolumesNegativeTest-2034797127-project] [instance: 6102940b-b0f0-4929-914b-8ce0e0f815fb] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:46:45.071194 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-5a89526e-1b62-43d6-908f-bcbb8a521021 tempest-VolumesNegativeTest-2034797127 tempest-VolumesNegativeTest-2034797127-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:46:45.071646 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-5a89526e-1b62-43d6-908f-bcbb8a521021 tempest-VolumesNegativeTest-2034797127 tempest-VolumesNegativeTest-2034797127-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:46:45.072457 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-5a89526e-1b62-43d6-908f-bcbb8a521021 tempest-VolumesNegativeTest-2034797127 tempest-VolumesNegativeTest-2034797127-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:46:45.072900 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-5a89526e-1b62-43d6-908f-bcbb8a521021 tempest-VolumesNegativeTest-2034797127 tempest-VolumesNegativeTest-2034797127-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:46:45.205295 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-5a89526e-1b62-43d6-908f-bcbb8a521021 tempest-VolumesNegativeTest-2034797127 tempest-VolumesNegativeTest-2034797127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e3191be5fa4c78984a51c936268e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce7334f1f35405d88dafe998dc5168c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:46:45.212863 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-5a89526e-1b62-43d6-908f-bcbb8a521021 tempest-VolumesNegativeTest-2034797127 tempest-VolumesNegativeTest-2034797127-project] 10.222.0.42 "GET /compute/v2.1/servers/6102940b-b0f0-4929-914b-8ce0e0f815fb" status: 200 len: 1470 microversion: 2.1 time: 0.152320 Jun 06 10:46:45.213422 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 449/879] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:46:45 2022] GET /compute/v2.1/servers/6102940b-b0f0-4929-914b-8ce0e0f815fb => generated 1470 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 10:46:46.231072 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-7c5a42ab-5f16-4982-9882-9383a7feecf4 tempest-VolumesNegativeTest-2034797127 tempest-VolumesNegativeTest-2034797127-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:46:46.231776 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-7c5a42ab-5f16-4982-9882-9383a7feecf4 tempest-VolumesNegativeTest-2034797127 tempest-VolumesNegativeTest-2034797127-project] [instance: 6102940b-b0f0-4929-914b-8ce0e0f815fb] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:46:46.238345 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-7c5a42ab-5f16-4982-9882-9383a7feecf4 tempest-VolumesNegativeTest-2034797127 tempest-VolumesNegativeTest-2034797127-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:46:46.238803 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-7c5a42ab-5f16-4982-9882-9383a7feecf4 tempest-VolumesNegativeTest-2034797127 tempest-VolumesNegativeTest-2034797127-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:46:46.239557 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-7c5a42ab-5f16-4982-9882-9383a7feecf4 tempest-VolumesNegativeTest-2034797127 tempest-VolumesNegativeTest-2034797127-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:46:46.240026 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-7c5a42ab-5f16-4982-9882-9383a7feecf4 tempest-VolumesNegativeTest-2034797127 tempest-VolumesNegativeTest-2034797127-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:46:46.366678 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-7c5a42ab-5f16-4982-9882-9383a7feecf4 tempest-VolumesNegativeTest-2034797127 tempest-VolumesNegativeTest-2034797127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e3191be5fa4c78984a51c936268e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce7334f1f35405d88dafe998dc5168c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:46:46.374838 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-7c5a42ab-5f16-4982-9882-9383a7feecf4 tempest-VolumesNegativeTest-2034797127 tempest-VolumesNegativeTest-2034797127-project] 10.222.0.42 "GET /compute/v2.1/servers/6102940b-b0f0-4929-914b-8ce0e0f815fb" status: 200 len: 1470 microversion: 2.1 time: 0.148028 Jun 06 10:46:46.375401 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 431/880] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:46:46 2022] GET /compute/v2.1/servers/6102940b-b0f0-4929-914b-8ce0e0f815fb => generated 1470 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:46:47.392185 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-fa0b1d90-445e-42a3-9c48-559a7db29930 tempest-VolumesNegativeTest-2034797127 tempest-VolumesNegativeTest-2034797127-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:46:47.392800 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-fa0b1d90-445e-42a3-9c48-559a7db29930 tempest-VolumesNegativeTest-2034797127 tempest-VolumesNegativeTest-2034797127-project] [instance: 6102940b-b0f0-4929-914b-8ce0e0f815fb] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:46:47.399095 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-fa0b1d90-445e-42a3-9c48-559a7db29930 tempest-VolumesNegativeTest-2034797127 tempest-VolumesNegativeTest-2034797127-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:46:47.399544 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-fa0b1d90-445e-42a3-9c48-559a7db29930 tempest-VolumesNegativeTest-2034797127 tempest-VolumesNegativeTest-2034797127-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:46:47.400352 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-fa0b1d90-445e-42a3-9c48-559a7db29930 tempest-VolumesNegativeTest-2034797127 tempest-VolumesNegativeTest-2034797127-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:46:47.400789 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-fa0b1d90-445e-42a3-9c48-559a7db29930 tempest-VolumesNegativeTest-2034797127 tempest-VolumesNegativeTest-2034797127-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:46:47.534569 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-fa0b1d90-445e-42a3-9c48-559a7db29930 tempest-VolumesNegativeTest-2034797127 tempest-VolumesNegativeTest-2034797127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e3191be5fa4c78984a51c936268e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce7334f1f35405d88dafe998dc5168c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:46:47.541931 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-fa0b1d90-445e-42a3-9c48-559a7db29930 tempest-VolumesNegativeTest-2034797127 tempest-VolumesNegativeTest-2034797127-project] 10.222.0.42 "GET /compute/v2.1/servers/6102940b-b0f0-4929-914b-8ce0e0f815fb" status: 200 len: 1470 microversion: 2.1 time: 0.153672 Jun 06 10:46:47.542484 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 450/881] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:46:47 2022] GET /compute/v2.1/servers/6102940b-b0f0-4929-914b-8ce0e0f815fb => generated 1470 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:46:48.260932 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-928e7359-6af7-49f0-add5-80435038dc44 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:46:48.261730 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-928e7359-6af7-49f0-add5-80435038dc44 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] [instance: 2e2eb841-906d-4ab2-b15e-63f07cf3037d] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:46:48.268752 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-928e7359-6af7-49f0-add5-80435038dc44 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:46:48.269198 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-928e7359-6af7-49f0-add5-80435038dc44 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:46:48.269953 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-928e7359-6af7-49f0-add5-80435038dc44 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:46:48.270378 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-928e7359-6af7-49f0-add5-80435038dc44 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:46:48.292380 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-928e7359-6af7-49f0-add5-80435038dc44 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] 10.222.0.42 "GET /compute/v2.1/servers/2e2eb841-906d-4ab2-b15e-63f07cf3037d/ips" status: 200 len: 148 microversion: 2.1 time: 0.035325 Jun 06 10:46:48.292933 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 432/882] 10.222.0.42 () {58 vars in 1247 bytes} [Mon Jun 6 10:46:48 2022] GET /compute/v2.1/servers/2e2eb841-906d-4ab2-b15e-63f07cf3037d/ips => generated 148 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 10:46:48.566415 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-666a8490-2c73-4a01-8bba-c04ea5127e82 tempest-VolumesNegativeTest-2034797127 tempest-VolumesNegativeTest-2034797127-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:46:48.567073 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-666a8490-2c73-4a01-8bba-c04ea5127e82 tempest-VolumesNegativeTest-2034797127 tempest-VolumesNegativeTest-2034797127-project] [instance: 6102940b-b0f0-4929-914b-8ce0e0f815fb] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:46:48.573928 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-666a8490-2c73-4a01-8bba-c04ea5127e82 tempest-VolumesNegativeTest-2034797127 tempest-VolumesNegativeTest-2034797127-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:46:48.574405 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-666a8490-2c73-4a01-8bba-c04ea5127e82 tempest-VolumesNegativeTest-2034797127 tempest-VolumesNegativeTest-2034797127-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:46:48.575215 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-666a8490-2c73-4a01-8bba-c04ea5127e82 tempest-VolumesNegativeTest-2034797127 tempest-VolumesNegativeTest-2034797127-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:46:48.575633 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-666a8490-2c73-4a01-8bba-c04ea5127e82 tempest-VolumesNegativeTest-2034797127 tempest-VolumesNegativeTest-2034797127-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:46:48.711812 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-666a8490-2c73-4a01-8bba-c04ea5127e82 tempest-VolumesNegativeTest-2034797127 tempest-VolumesNegativeTest-2034797127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e3191be5fa4c78984a51c936268e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce7334f1f35405d88dafe998dc5168c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:46:48.719209 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-666a8490-2c73-4a01-8bba-c04ea5127e82 tempest-VolumesNegativeTest-2034797127 tempest-VolumesNegativeTest-2034797127-project] 10.222.0.42 "GET /compute/v2.1/servers/6102940b-b0f0-4929-914b-8ce0e0f815fb" status: 200 len: 1470 microversion: 2.1 time: 0.157321 Jun 06 10:46:48.719773 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 451/883] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:46:48 2022] GET /compute/v2.1/servers/6102940b-b0f0-4929-914b-8ce0e0f815fb => generated 1470 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:46:49.492187 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [req-d67c7506-9591-4bb8-a9b8-5d2a4e24f214 req-7460cc14-4f69-43a6-ab6f-f9d115c0f65d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6102940b-b0f0-4929-914b-8ce0e0f815fb", "name": "network-vif-deleted", "tag": "6cc3dc2f-30db-4280-b3e9-60794583cc04"}]} {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 10:46:49.523461 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [req-d67c7506-9591-4bb8-a9b8-5d2a4e24f214 req-7460cc14-4f69-43a6-ab6f-f9d115c0f65d service nova] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:46:49.523991 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [req-d67c7506-9591-4bb8-a9b8-5d2a4e24f214 req-7460cc14-4f69-43a6-ab6f-f9d115c0f65d service nova] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:46:49.537889 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.compute.server_external_events [req-d67c7506-9591-4bb8-a9b8-5d2a4e24f214 req-7460cc14-4f69-43a6-ab6f-f9d115c0f65d service nova] Creating event network-vif-deleted:6cc3dc2f-30db-4280-b3e9-60794583cc04 for instance 6102940b-b0f0-4929-914b-8ce0e0f815fb on hv-cinder-84482 Jun 06 10:46:49.546036 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [req-d67c7506-9591-4bb8-a9b8-5d2a4e24f214 req-7460cc14-4f69-43a6-ab6f-f9d115c0f65d service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058640 Jun 06 10:46:49.546647 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 433/884] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Jun 6 10:46:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 10:46:49.622755 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-18f64a9d-7791-49c8-89e5-8a4ee6745bfe tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8369e1b2-f083-4c13-8ea5-6f36473fe24f"}} {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 10:46:49.624017 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-18f64a9d-7791-49c8-89e5-8a4ee6745bfe tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] [instance: 2e2eb841-906d-4ab2-b15e-63f07cf3037d] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:46:49.631453 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-18f64a9d-7791-49c8-89e5-8a4ee6745bfe tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:46:49.631950 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-18f64a9d-7791-49c8-89e5-8a4ee6745bfe tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:46:49.632733 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-18f64a9d-7791-49c8-89e5-8a4ee6745bfe tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:46:49.633169 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-18f64a9d-7791-49c8-89e5-8a4ee6745bfe tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:46:49.736648 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-ad352fd3-7fc4-4158-ad7b-9ab1ebafb32b tempest-VolumesNegativeTest-2034797127 tempest-VolumesNegativeTest-2034797127-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:46:49.737433 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-ad352fd3-7fc4-4158-ad7b-9ab1ebafb32b tempest-VolumesNegativeTest-2034797127 tempest-VolumesNegativeTest-2034797127-project] [instance: 6102940b-b0f0-4929-914b-8ce0e0f815fb] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:46:49.743574 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-ad352fd3-7fc4-4158-ad7b-9ab1ebafb32b tempest-VolumesNegativeTest-2034797127 tempest-VolumesNegativeTest-2034797127-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:46:49.744061 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-ad352fd3-7fc4-4158-ad7b-9ab1ebafb32b tempest-VolumesNegativeTest-2034797127 tempest-VolumesNegativeTest-2034797127-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:46:49.744823 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-ad352fd3-7fc4-4158-ad7b-9ab1ebafb32b tempest-VolumesNegativeTest-2034797127 tempest-VolumesNegativeTest-2034797127-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:46:49.745265 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-ad352fd3-7fc4-4158-ad7b-9ab1ebafb32b tempest-VolumesNegativeTest-2034797127 tempest-VolumesNegativeTest-2034797127-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:46:49.776034 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-ad352fd3-7fc4-4158-ad7b-9ab1ebafb32b tempest-VolumesNegativeTest-2034797127 tempest-VolumesNegativeTest-2034797127-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:46:49.776478 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-ad352fd3-7fc4-4158-ad7b-9ab1ebafb32b tempest-VolumesNegativeTest-2034797127 tempest-VolumesNegativeTest-2034797127-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:46:49.776921 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.objects.instance [None req-ad352fd3-7fc4-4158-ad7b-9ab1ebafb32b tempest-VolumesNegativeTest-2034797127 tempest-VolumesNegativeTest-2034797127-project] Lazy-loading 'fault' on Instance uuid 6102940b-b0f0-4929-914b-8ce0e0f815fb {{(pid=129350) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 06 10:46:49.817950 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-ad352fd3-7fc4-4158-ad7b-9ab1ebafb32b tempest-VolumesNegativeTest-2034797127 tempest-VolumesNegativeTest-2034797127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e3191be5fa4c78984a51c936268e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce7334f1f35405d88dafe998dc5168c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:46:49.825290 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-ad352fd3-7fc4-4158-ad7b-9ab1ebafb32b tempest-VolumesNegativeTest-2034797127 tempest-VolumesNegativeTest-2034797127-project] 10.222.0.42 "GET /compute/v2.1/servers/6102940b-b0f0-4929-914b-8ce0e0f815fb" status: 200 len: 1304 microversion: 2.1 time: 0.092927 Jun 06 10:46:49.825843 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 434/885] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:46:49 2022] GET /compute/v2.1/servers/6102940b-b0f0-4929-914b-8ce0e0f815fb => generated 1304 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 10:46:50.000625 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-18f64a9d-7791-49c8-89e5-8a4ee6745bfe tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] 10.222.0.42 "POST /compute/v2.1/servers/2e2eb841-906d-4ab2-b15e-63f07cf3037d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.382154 Jun 06 10:46:50.001715 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 452/886] 10.222.0.42 () {60 vars in 1322 bytes} [Mon Jun 6 10:46:49 2022] POST /compute/v2.1/servers/2e2eb841-906d-4ab2-b15e-63f07cf3037d/os-volume_attachments => generated 194 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 10:46:50.842871 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-07f35397-9dab-42a9-9cee-3c5c92b061b2 tempest-VolumesNegativeTest-2034797127 tempest-VolumesNegativeTest-2034797127-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:46:50.843485 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-07f35397-9dab-42a9-9cee-3c5c92b061b2 tempest-VolumesNegativeTest-2034797127 tempest-VolumesNegativeTest-2034797127-project] [instance: 6102940b-b0f0-4929-914b-8ce0e0f815fb] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:46:50.850679 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-07f35397-9dab-42a9-9cee-3c5c92b061b2 tempest-VolumesNegativeTest-2034797127 tempest-VolumesNegativeTest-2034797127-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:46:50.851122 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-07f35397-9dab-42a9-9cee-3c5c92b061b2 tempest-VolumesNegativeTest-2034797127 tempest-VolumesNegativeTest-2034797127-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:46:50.851920 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-07f35397-9dab-42a9-9cee-3c5c92b061b2 tempest-VolumesNegativeTest-2034797127 tempest-VolumesNegativeTest-2034797127-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:46:50.852352 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-07f35397-9dab-42a9-9cee-3c5c92b061b2 tempest-VolumesNegativeTest-2034797127 tempest-VolumesNegativeTest-2034797127-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:46:50.865348 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.wsgi [None req-07f35397-9dab-42a9-9cee-3c5c92b061b2 tempest-VolumesNegativeTest-2034797127 tempest-VolumesNegativeTest-2034797127-project] HTTP exception thrown: Instance 6102940b-b0f0-4929-914b-8ce0e0f815fb could not be found. Jun 06 10:46:50.866987 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-07f35397-9dab-42a9-9cee-3c5c92b061b2 tempest-VolumesNegativeTest-2034797127 tempest-VolumesNegativeTest-2034797127-project] Request method failure captured: Jun 06 10:46:50.866987 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: request: GET /compute/v2.1/servers/6102940b-b0f0-4929-914b-8ce0e0f815fb HTTP/1.1 Jun 06 10:46:50.866987 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: Accept: application/json Jun 06 10:46:50.866987 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: Accept-Encoding: identity Jun 06 10:46:50.866987 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: Connection: close Jun 06 10:46:50.866987 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: Content-Length: 0 Jun 06 10:46:50.866987 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: Content-Type: application/json Jun 06 10:46:50.866987 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: Host: 10.222.0.42 Jun 06 10:46:50.866987 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: Openstack-System-Scope: None Jun 06 10:46:50.866987 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: User-Agent: python-urllib3/1.26.9 Jun 06 10:46:50.866987 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Auth-Token: gAAAAABindsG5_BbHoKG6cc8AiqTcNi-tiB8-YPblnHp6E2e462F8f3ROnwz7yMynH5IB8EueQsc_FirkrpzZX5CIDPr3ny7-5EMrtERHO2NJJdpLzYdvfDGFjVGsuAvfQkZPWKtfwYzP9fQ1csMaJt3jRVZeoswllFQNeNwjNNVUErLoz_vxag Jun 06 10:46:50.866987 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Domain-Id: None Jun 06 10:46:50.866987 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Domain-Name: None Jun 06 10:46:50.866987 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Identity-Status: Confirmed Jun 06 10:46:50.866987 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Is-Admin-Project: True Jun 06 10:46:50.866987 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Project-Domain-Id: default Jun 06 10:46:50.866987 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Project-Domain-Name: Default Jun 06 10:46:50.866987 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Project-Id: bce7334f1f35405d88dafe998dc5168c Jun 06 10:46:50.866987 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Project-Name: tempest-VolumesNegativeTest-2034797127 Jun 06 10:46:50.866987 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Role: member,reader Jun 06 10:46:50.866987 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Roles: member,reader Jun 06 10:46:50.868578 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/bce7334f1f35405d88dafe998dc5168c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/bce7334f1f35405d88dafe998dc5168c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/bce7334f1f35405d88dafe998dc5168c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_bce7334f1f35405d88dafe998dc5168c", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Jun 06 10:46:50.868578 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Tenant: tempest-VolumesNegativeTest-2034797127 Jun 06 10:46:50.868578 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Tenant-Id: bce7334f1f35405d88dafe998dc5168c Jun 06 10:46:50.868578 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Tenant-Name: tempest-VolumesNegativeTest-2034797127 Jun 06 10:46:50.868578 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-User: tempest-VolumesNegativeTest-2034797127-project Jun 06 10:46:50.868578 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-User-Domain-Id: default Jun 06 10:46:50.868578 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-User-Domain-Name: Default Jun 06 10:46:50.868578 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-User-Id: 37e3191be5fa4c78984a51c936268e00 Jun 06 10:46:50.868578 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-User-Name: tempest-VolumesNegativeTest-2034797127-project Jun 06 10:46:50.868578 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: method: > Jun 06 10:46:50.868578 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: exception: Instance 6102940b-b0f0-4929-914b-8ce0e0f815fb could not be found. Jun 06 10:46:50.868578 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: action_args: {'id': '6102940b-b0f0-4929-914b-8ce0e0f815fb'} Jun 06 10:46:50.869485 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 10:46:50.869485 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 10:46:50.869485 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 06 10:46:50.869485 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 06 10:46:50.869485 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 06 10:46:50.869485 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 06 10:46:50.869485 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 06 10:46:50.869485 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 06 10:46:50.869485 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 06 10:46:50.869485 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 06 10:46:50.869485 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6102940b-b0f0-4929-914b-8ce0e0f815fb could not be found. Jun 06 10:46:50.869485 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi Jun 06 10:46:50.869485 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 10:46:50.869485 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi Jun 06 10:46:50.869485 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 10:46:50.869485 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 10:46:50.869485 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 10:46:50.869485 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 10:46:50.869485 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 10:46:50.869485 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 10:46:50.870920 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 10:46:50.870920 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 06 10:46:50.870920 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 06 10:46:50.870920 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 06 10:46:50.870920 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 06 10:46:50.870920 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 06 10:46:50.870920 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 06 10:46:50.870920 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6102940b-b0f0-4929-914b-8ce0e0f815fb could not be found. Jun 06 10:46:50.870920 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi Jun 06 10:46:50.870920 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 10:46:50.870920 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi Jun 06 10:46:50.870920 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 10:46:50.870920 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 10:46:50.870920 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 10:46:50.870920 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 10:46:50.870920 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 10:46:50.870920 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6102940b-b0f0-4929-914b-8ce0e0f815fb could not be found. Jun 06 10:46:50.870920 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi Jun 06 10:46:50.872094 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-07f35397-9dab-42a9-9cee-3c5c92b061b2 tempest-VolumesNegativeTest-2034797127 tempest-VolumesNegativeTest-2034797127-project] Returning 404 to user: Instance 6102940b-b0f0-4929-914b-8ce0e0f815fb could not be found. {{(pid=129350) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 10:46:50.872094 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-07f35397-9dab-42a9-9cee-3c5c92b061b2 tempest-VolumesNegativeTest-2034797127 tempest-VolumesNegativeTest-2034797127-project] 10.222.0.42 "GET /compute/v2.1/servers/6102940b-b0f0-4929-914b-8ce0e0f815fb" status: 404 len: 111 microversion: 2.1 time: 0.029398 Jun 06 10:46:50.872094 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 435/887] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:46:50 2022] GET /compute/v2.1/servers/6102940b-b0f0-4929-914b-8ce0e0f815fb => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 06 10:46:56.456945 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-f61917de-809e-4d9a-a0ce-191ee7aad0b9 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8369e1b2-f083-4c13-8ea5-6f36473fe24f"}} {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 10:46:56.458210 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-f61917de-809e-4d9a-a0ce-191ee7aad0b9 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] [instance: 2e2eb841-906d-4ab2-b15e-63f07cf3037d] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:46:56.465346 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-f61917de-809e-4d9a-a0ce-191ee7aad0b9 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:46:56.466005 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-f61917de-809e-4d9a-a0ce-191ee7aad0b9 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:46:56.467042 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-f61917de-809e-4d9a-a0ce-191ee7aad0b9 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:46:56.467741 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-f61917de-809e-4d9a-a0ce-191ee7aad0b9 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:46:56.489817 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG dbcounter [-] [129349] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=129349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 10:46:56.561204 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.wsgi [None req-f61917de-809e-4d9a-a0ce-191ee7aad0b9 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] HTTP exception thrown: Invalid volume: volume 8369e1b2-f083-4c13-8ea5-6f36473fe24f is already attached to instances: 2e2eb841-906d-4ab2-b15e-63f07cf3037d Jun 06 10:46:56.562915 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-f61917de-809e-4d9a-a0ce-191ee7aad0b9 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Request method failure captured: Jun 06 10:46:56.562915 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: request: POST /compute/v2.1/servers/2e2eb841-906d-4ab2-b15e-63f07cf3037d/os-volume_attachments HTTP/1.1 Jun 06 10:46:56.562915 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: Accept: application/json Jun 06 10:46:56.562915 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: Accept-Encoding: identity Jun 06 10:46:56.562915 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: Connection: close Jun 06 10:46:56.562915 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: Content-Length: 74 Jun 06 10:46:56.562915 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: Content-Type: application/json Jun 06 10:46:56.562915 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: Host: 10.222.0.42 Jun 06 10:46:56.562915 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: Openstack-System-Scope: None Jun 06 10:46:56.562915 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: User-Agent: python-urllib3/1.26.9 Jun 06 10:46:56.562915 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Auth-Token: gAAAAABindpS5StX_xHu79Eyze6WiReBQv-1XmH_nbXfOmEXKeceOSLZM5qrKAT8lmCw6P5JEWqX6Nq9MOy22mDxxwSXFHT-nuQ59QQYMYHodXP_RU6pUiqpnXRk4PCXE--rTT-t8YJ-1daoywKB7L9jlYu_naOtOmjpMkLKZOiBTDyqPdUS4xY Jun 06 10:46:56.562915 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Domain-Id: None Jun 06 10:46:56.562915 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Domain-Name: None Jun 06 10:46:56.562915 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Identity-Status: Confirmed Jun 06 10:46:56.562915 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Is-Admin-Project: True Jun 06 10:46:56.562915 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Project-Domain-Id: default Jun 06 10:46:56.562915 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Project-Domain-Name: Default Jun 06 10:46:56.562915 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Project-Id: 92244b4ae17d49bebe621e803bd9ae58 Jun 06 10:46:56.562915 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Project-Name: tempest-AttachVolumeNegativeTest-363942965 Jun 06 10:46:56.562915 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Role: member,reader Jun 06 10:46:56.562915 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Roles: member,reader Jun 06 10:46:56.564649 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/92244b4ae17d49bebe621e803bd9ae58"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/92244b4ae17d49bebe621e803bd9ae58"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/92244b4ae17d49bebe621e803bd9ae58"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_92244b4ae17d49bebe621e803bd9ae58", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Jun 06 10:46:56.564649 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Tenant: tempest-AttachVolumeNegativeTest-363942965 Jun 06 10:46:56.564649 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Tenant-Id: 92244b4ae17d49bebe621e803bd9ae58 Jun 06 10:46:56.564649 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-363942965 Jun 06 10:46:56.564649 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-User: tempest-AttachVolumeNegativeTest-363942965-project Jun 06 10:46:56.564649 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-User-Domain-Id: default Jun 06 10:46:56.564649 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-User-Domain-Name: Default Jun 06 10:46:56.564649 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-User-Id: 7ba341ea1ac34874bbfb8b2f713aea1b Jun 06 10:46:56.564649 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-User-Name: tempest-AttachVolumeNegativeTest-363942965-project Jun 06 10:46:56.564649 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: Jun 06 10:46:56.564649 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: {"volumeAttachment": {"volumeId": "8369e1b2-f083-4c13-8ea5-6f36473fe24f"}} Jun 06 10:46:56.564649 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: method: > Jun 06 10:46:56.566453 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: exception: Invalid volume: volume 8369e1b2-f083-4c13-8ea5-6f36473fe24f is already attached to instances: 2e2eb841-906d-4ab2-b15e-63f07cf3037d Jun 06 10:46:56.566453 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: action_args: {'server_id': '2e2eb841-906d-4ab2-b15e-63f07cf3037d', 'body': {'volumeAttachment': {'volumeId': '8369e1b2-f083-4c13-8ea5-6f36473fe24f'}}} Jun 06 10:46:56.566453 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 10:46:56.566453 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 10:46:56.566453 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 06 10:46:56.566453 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 06 10:46:56.566453 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 06 10:46:56.566453 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 06 10:46:56.566453 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 06 10:46:56.566453 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 06 10:46:56.566453 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jun 06 10:46:56.566453 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jun 06 10:46:56.566453 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jun 06 10:46:56.566453 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jun 06 10:46:56.566453 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 8369e1b2-f083-4c13-8ea5-6f36473fe24f is already attached to instances: 2e2eb841-906d-4ab2-b15e-63f07cf3037d Jun 06 10:46:56.566453 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Jun 06 10:46:56.566453 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 10:46:56.566453 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Jun 06 10:46:56.566453 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 10:46:56.567923 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 10:46:56.567923 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 10:46:56.567923 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 10:46:56.567923 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 10:46:56.567923 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 10:46:56.567923 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 10:46:56.567923 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 06 10:46:56.567923 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 06 10:46:56.567923 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 06 10:46:56.567923 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 06 10:46:56.567923 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 06 10:46:56.567923 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 06 10:46:56.567923 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jun 06 10:46:56.567923 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 06 10:46:56.567923 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 8369e1b2-f083-4c13-8ea5-6f36473fe24f is already attached to instances: 2e2eb841-906d-4ab2-b15e-63f07cf3037d Jun 06 10:46:56.567923 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Jun 06 10:46:56.567923 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 10:46:56.567923 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Jun 06 10:46:56.567923 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 10:46:56.567923 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 10:46:56.569562 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 10:46:56.569562 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 10:46:56.569562 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 10:46:56.569562 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 8369e1b2-f083-4c13-8ea5-6f36473fe24f is already attached to instances: 2e2eb841-906d-4ab2-b15e-63f07cf3037d Jun 06 10:46:56.569562 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Jun 06 10:46:56.569562 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-f61917de-809e-4d9a-a0ce-191ee7aad0b9 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Returning 400 to user: Invalid volume: volume 8369e1b2-f083-4c13-8ea5-6f36473fe24f is already attached to instances: 2e2eb841-906d-4ab2-b15e-63f07cf3037d {{(pid=129349) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 10:46:56.569562 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-f61917de-809e-4d9a-a0ce-191ee7aad0b9 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] 10.222.0.42 "POST /compute/v2.1/servers/2e2eb841-906d-4ab2-b15e-63f07cf3037d/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.113342 Jun 06 10:46:56.569562 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 453/888] 10.222.0.42 () {60 vars in 1322 bytes} [Mon Jun 6 10:46:56 2022] POST /compute/v2.1/servers/2e2eb841-906d-4ab2-b15e-63f07cf3037d/os-volume_attachments => generated 174 bytes in 115 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 06 10:46:56.626504 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-32dbbe54-53a9-4f03-91a3-45db916ab03c tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:46:56.627119 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-32dbbe54-53a9-4f03-91a3-45db916ab03c tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] [instance: 2e2eb841-906d-4ab2-b15e-63f07cf3037d] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:46:56.636269 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-32dbbe54-53a9-4f03-91a3-45db916ab03c tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:46:56.636976 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-32dbbe54-53a9-4f03-91a3-45db916ab03c tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:46:56.637746 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-32dbbe54-53a9-4f03-91a3-45db916ab03c tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:46:56.638360 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-32dbbe54-53a9-4f03-91a3-45db916ab03c tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:46:56.733303 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG dbcounter [-] [129350] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=129350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 10:46:56.735917 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.objects.instance [None req-32dbbe54-53a9-4f03-91a3-45db916ab03c tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lazy-loading 'services' on Instance uuid 2e2eb841-906d-4ab2-b15e-63f07cf3037d {{(pid=129350) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 06 10:46:56.815561 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-32dbbe54-53a9-4f03-91a3-45db916ab03c tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] 10.222.0.42 "DELETE /compute/v2.1/servers/2e2eb841-906d-4ab2-b15e-63f07cf3037d/os-volume_attachments/8369e1b2-f083-4c13-8ea5-6f36473fe24f" status: 202 len: 0 microversion: 2.1 time: 0.192133 Jun 06 10:46:56.817251 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 436/889] 10.222.0.42 () {58 vars in 1415 bytes} [Mon Jun 6 10:46:56 2022] DELETE /compute/v2.1/servers/2e2eb841-906d-4ab2-b15e-63f07cf3037d/os-volume_attachments/8369e1b2-f083-4c13-8ea5-6f36473fe24f => generated 0 bytes in 195 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 06 10:46:56.828229 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-b765f7f5-ca32-4811-98cc-00b022b4f2a7 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:46:56.830123 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-b765f7f5-ca32-4811-98cc-00b022b4f2a7 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] [instance: 2e2eb841-906d-4ab2-b15e-63f07cf3037d] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:46:56.840103 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-b765f7f5-ca32-4811-98cc-00b022b4f2a7 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:46:56.840855 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-b765f7f5-ca32-4811-98cc-00b022b4f2a7 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:46:56.841794 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-b765f7f5-ca32-4811-98cc-00b022b4f2a7 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:46:56.842404 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-b765f7f5-ca32-4811-98cc-00b022b4f2a7 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:46:56.882089 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-b765f7f5-ca32-4811-98cc-00b022b4f2a7 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] 10.222.0.42 "GET /compute/v2.1/servers/2e2eb841-906d-4ab2-b15e-63f07cf3037d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060818 Jun 06 10:46:56.883485 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 454/890] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jun 6 10:46:56 2022] GET /compute/v2.1/servers/2e2eb841-906d-4ab2-b15e-63f07cf3037d/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 06 10:46:57.899080 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-bf90cce5-c1d7-4e65-8ae1-c93dd9c7d206 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:46:57.903063 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-bf90cce5-c1d7-4e65-8ae1-c93dd9c7d206 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] [instance: 2e2eb841-906d-4ab2-b15e-63f07cf3037d] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:46:57.911416 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-bf90cce5-c1d7-4e65-8ae1-c93dd9c7d206 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:46:57.912144 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-bf90cce5-c1d7-4e65-8ae1-c93dd9c7d206 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:46:57.913099 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-bf90cce5-c1d7-4e65-8ae1-c93dd9c7d206 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:46:57.913725 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-bf90cce5-c1d7-4e65-8ae1-c93dd9c7d206 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:46:57.960782 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-bf90cce5-c1d7-4e65-8ae1-c93dd9c7d206 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] 10.222.0.42 "GET /compute/v2.1/servers/2e2eb841-906d-4ab2-b15e-63f07cf3037d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.069905 Jun 06 10:46:57.961366 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 437/891] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jun 6 10:46:57 2022] GET /compute/v2.1/servers/2e2eb841-906d-4ab2-b15e-63f07cf3037d/os-volume_attachments => generated 25 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 06 10:46:58.053629 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-4d556fdd-85bc-42ff-8bdf-8b2630e46169 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:46:58.054753 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-4d556fdd-85bc-42ff-8bdf-8b2630e46169 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] [instance: 2e2eb841-906d-4ab2-b15e-63f07cf3037d] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:46:58.070208 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-4d556fdd-85bc-42ff-8bdf-8b2630e46169 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:46:58.070886 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-4d556fdd-85bc-42ff-8bdf-8b2630e46169 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:46:58.071774 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-4d556fdd-85bc-42ff-8bdf-8b2630e46169 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:46:58.072265 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-4d556fdd-85bc-42ff-8bdf-8b2630e46169 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:46:58.125661 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-4d556fdd-85bc-42ff-8bdf-8b2630e46169 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] [instance: 2e2eb841-906d-4ab2-b15e-63f07cf3037d] Going to try to terminate instance {{(pid=129349) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 06 10:46:58.289591 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-4d556fdd-85bc-42ff-8bdf-8b2630e46169 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] 10.222.0.42 "DELETE /compute/v2.1/servers/2e2eb841-906d-4ab2-b15e-63f07cf3037d" status: 204 len: 0 microversion: 2.1 time: 0.240836 Jun 06 10:46:58.291264 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 455/892] 10.222.0.42 () {58 vars in 1238 bytes} [Mon Jun 6 10:46:58 2022] DELETE /compute/v2.1/servers/2e2eb841-906d-4ab2-b15e-63f07cf3037d => generated 0 bytes in 243 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 06 10:46:58.311519 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-537eb568-b72b-4da3-bd77-a9a20a67cfe0 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:46:58.312944 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-537eb568-b72b-4da3-bd77-a9a20a67cfe0 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] [instance: 2e2eb841-906d-4ab2-b15e-63f07cf3037d] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:46:58.328453 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-537eb568-b72b-4da3-bd77-a9a20a67cfe0 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:46:58.329372 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-537eb568-b72b-4da3-bd77-a9a20a67cfe0 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:46:58.330905 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-537eb568-b72b-4da3-bd77-a9a20a67cfe0 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:46:58.331533 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-537eb568-b72b-4da3-bd77-a9a20a67cfe0 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:46:58.886143 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-537eb568-b72b-4da3-bd77-a9a20a67cfe0 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ba341ea1ac34874bbfb8b2f713aea1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92244b4ae17d49bebe621e803bd9ae58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:46:58.899243 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-537eb568-b72b-4da3-bd77-a9a20a67cfe0 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] 10.222.0.42 "GET /compute/v2.1/servers/2e2eb841-906d-4ab2-b15e-63f07cf3037d" status: 200 len: 1678 microversion: 2.1 time: 0.598766 Jun 06 10:46:58.899905 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 438/893] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:46:58 2022] GET /compute/v2.1/servers/2e2eb841-906d-4ab2-b15e-63f07cf3037d => generated 1678 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:46:59.922767 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-fa4cd4a4-df51-4e6e-abd7-bb3fbbeb3234 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:46:59.925462 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-fa4cd4a4-df51-4e6e-abd7-bb3fbbeb3234 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] [instance: 2e2eb841-906d-4ab2-b15e-63f07cf3037d] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:46:59.934506 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-fa4cd4a4-df51-4e6e-abd7-bb3fbbeb3234 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:46:59.935219 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-fa4cd4a4-df51-4e6e-abd7-bb3fbbeb3234 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:46:59.936211 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-fa4cd4a4-df51-4e6e-abd7-bb3fbbeb3234 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:46:59.936938 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-fa4cd4a4-df51-4e6e-abd7-bb3fbbeb3234 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:47:00.189230 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-fa4cd4a4-df51-4e6e-abd7-bb3fbbeb3234 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ba341ea1ac34874bbfb8b2f713aea1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92244b4ae17d49bebe621e803bd9ae58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:47:00.203832 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-fa4cd4a4-df51-4e6e-abd7-bb3fbbeb3234 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] 10.222.0.42 "GET /compute/v2.1/servers/2e2eb841-906d-4ab2-b15e-63f07cf3037d" status: 200 len: 1678 microversion: 2.1 time: 0.285502 Jun 06 10:47:00.206267 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 456/894] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:46:59 2022] GET /compute/v2.1/servers/2e2eb841-906d-4ab2-b15e-63f07cf3037d => generated 1678 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:47:00.945084 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [req-6a8dd6fa-c67f-4745-b130-95fb0880d134 req-59e31fce-db0a-4161-bfd6-9dda2856b86b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e2eb841-906d-4ab2-b15e-63f07cf3037d", "name": "network-vif-deleted", "tag": "1efcaca9-ec5c-468f-903b-a288d6bc742f"}]} {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 10:47:00.993231 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [req-6a8dd6fa-c67f-4745-b130-95fb0880d134 req-59e31fce-db0a-4161-bfd6-9dda2856b86b service nova] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:47:00.993679 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [req-6a8dd6fa-c67f-4745-b130-95fb0880d134 req-59e31fce-db0a-4161-bfd6-9dda2856b86b service nova] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:47:01.031220 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.compute.server_external_events [req-6a8dd6fa-c67f-4745-b130-95fb0880d134 req-59e31fce-db0a-4161-bfd6-9dda2856b86b service nova] Creating event network-vif-deleted:1efcaca9-ec5c-468f-903b-a288d6bc742f for instance 2e2eb841-906d-4ab2-b15e-63f07cf3037d on hv-cinder-84482 Jun 06 10:47:01.048958 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [req-6a8dd6fa-c67f-4745-b130-95fb0880d134 req-59e31fce-db0a-4161-bfd6-9dda2856b86b service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108839 Jun 06 10:47:01.063187 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 439/895] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Jun 6 10:47:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 06 10:47:01.223353 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-90500592-a05f-4267-a75b-9fe7721309f7 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:47:01.224006 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-90500592-a05f-4267-a75b-9fe7721309f7 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] [instance: 2e2eb841-906d-4ab2-b15e-63f07cf3037d] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:47:01.231084 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-90500592-a05f-4267-a75b-9fe7721309f7 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:47:01.231735 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-90500592-a05f-4267-a75b-9fe7721309f7 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:47:01.232897 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-90500592-a05f-4267-a75b-9fe7721309f7 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:47:01.233500 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-90500592-a05f-4267-a75b-9fe7721309f7 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:47:01.282906 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-90500592-a05f-4267-a75b-9fe7721309f7 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:47:01.283360 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-90500592-a05f-4267-a75b-9fe7721309f7 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:47:01.285153 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.objects.instance [None req-90500592-a05f-4267-a75b-9fe7721309f7 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lazy-loading 'fault' on Instance uuid 2e2eb841-906d-4ab2-b15e-63f07cf3037d {{(pid=129349) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 06 10:47:01.333695 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-90500592-a05f-4267-a75b-9fe7721309f7 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ba341ea1ac34874bbfb8b2f713aea1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92244b4ae17d49bebe621e803bd9ae58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:47:01.343261 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-90500592-a05f-4267-a75b-9fe7721309f7 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] 10.222.0.42 "GET /compute/v2.1/servers/2e2eb841-906d-4ab2-b15e-63f07cf3037d" status: 200 len: 1330 microversion: 2.1 time: 0.124416 Jun 06 10:47:01.344528 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 457/896] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:47:01 2022] GET /compute/v2.1/servers/2e2eb841-906d-4ab2-b15e-63f07cf3037d => generated 1330 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:47:02.369416 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-dc5dd89e-61cf-426d-bbe8-9950ccea1cfb tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:47:02.370886 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-dc5dd89e-61cf-426d-bbe8-9950ccea1cfb tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] [instance: 2e2eb841-906d-4ab2-b15e-63f07cf3037d] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:47:02.388482 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG dbcounter [-] [129350] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=1 {{(pid=129350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 10:47:02.391602 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-dc5dd89e-61cf-426d-bbe8-9950ccea1cfb tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:47:02.392349 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-dc5dd89e-61cf-426d-bbe8-9950ccea1cfb tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:47:02.393999 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-dc5dd89e-61cf-426d-bbe8-9950ccea1cfb tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:47:02.394678 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-dc5dd89e-61cf-426d-bbe8-9950ccea1cfb tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:47:02.413313 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.wsgi [None req-dc5dd89e-61cf-426d-bbe8-9950ccea1cfb tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] HTTP exception thrown: Instance 2e2eb841-906d-4ab2-b15e-63f07cf3037d could not be found. Jun 06 10:47:02.415711 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-dc5dd89e-61cf-426d-bbe8-9950ccea1cfb tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Request method failure captured: Jun 06 10:47:02.415711 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: request: GET /compute/v2.1/servers/2e2eb841-906d-4ab2-b15e-63f07cf3037d HTTP/1.1 Jun 06 10:47:02.415711 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: Accept: application/json Jun 06 10:47:02.415711 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: Accept-Encoding: identity Jun 06 10:47:02.415711 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: Connection: close Jun 06 10:47:02.415711 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: Content-Length: 0 Jun 06 10:47:02.415711 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: Content-Type: application/json Jun 06 10:47:02.415711 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: Host: 10.222.0.42 Jun 06 10:47:02.415711 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: Openstack-System-Scope: None Jun 06 10:47:02.415711 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: User-Agent: python-urllib3/1.26.9 Jun 06 10:47:02.415711 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Auth-Token: gAAAAABindpS5StX_xHu79Eyze6WiReBQv-1XmH_nbXfOmEXKeceOSLZM5qrKAT8lmCw6P5JEWqX6Nq9MOy22mDxxwSXFHT-nuQ59QQYMYHodXP_RU6pUiqpnXRk4PCXE--rTT-t8YJ-1daoywKB7L9jlYu_naOtOmjpMkLKZOiBTDyqPdUS4xY Jun 06 10:47:02.415711 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Domain-Id: None Jun 06 10:47:02.415711 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Domain-Name: None Jun 06 10:47:02.415711 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Identity-Status: Confirmed Jun 06 10:47:02.415711 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Is-Admin-Project: True Jun 06 10:47:02.415711 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Project-Domain-Id: default Jun 06 10:47:02.415711 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Project-Domain-Name: Default Jun 06 10:47:02.415711 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Project-Id: 92244b4ae17d49bebe621e803bd9ae58 Jun 06 10:47:02.415711 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Project-Name: tempest-AttachVolumeNegativeTest-363942965 Jun 06 10:47:02.415711 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Role: member,reader Jun 06 10:47:02.415711 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Roles: member,reader Jun 06 10:47:02.417254 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/92244b4ae17d49bebe621e803bd9ae58"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/92244b4ae17d49bebe621e803bd9ae58"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/92244b4ae17d49bebe621e803bd9ae58"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_92244b4ae17d49bebe621e803bd9ae58", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Jun 06 10:47:02.417254 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Tenant: tempest-AttachVolumeNegativeTest-363942965 Jun 06 10:47:02.417254 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Tenant-Id: 92244b4ae17d49bebe621e803bd9ae58 Jun 06 10:47:02.417254 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-363942965 Jun 06 10:47:02.417254 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-User: tempest-AttachVolumeNegativeTest-363942965-project Jun 06 10:47:02.417254 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-User-Domain-Id: default Jun 06 10:47:02.417254 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-User-Domain-Name: Default Jun 06 10:47:02.417254 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-User-Id: 7ba341ea1ac34874bbfb8b2f713aea1b Jun 06 10:47:02.417254 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-User-Name: tempest-AttachVolumeNegativeTest-363942965-project Jun 06 10:47:02.417254 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: method: > Jun 06 10:47:02.417254 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: exception: Instance 2e2eb841-906d-4ab2-b15e-63f07cf3037d could not be found. Jun 06 10:47:02.417254 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: action_args: {'id': '2e2eb841-906d-4ab2-b15e-63f07cf3037d'} Jun 06 10:47:02.418042 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 10:47:02.418042 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 10:47:02.418042 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 06 10:47:02.418042 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 06 10:47:02.418042 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 06 10:47:02.418042 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 06 10:47:02.418042 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 06 10:47:02.418042 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 06 10:47:02.418042 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 06 10:47:02.418042 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 06 10:47:02.418042 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2e2eb841-906d-4ab2-b15e-63f07cf3037d could not be found. Jun 06 10:47:02.418042 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi Jun 06 10:47:02.418042 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 10:47:02.418042 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi Jun 06 10:47:02.418042 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 10:47:02.418042 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 10:47:02.418042 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 10:47:02.418042 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 10:47:02.418042 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 10:47:02.418042 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 10:47:02.419370 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 10:47:02.419370 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 06 10:47:02.419370 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 06 10:47:02.419370 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 06 10:47:02.419370 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 06 10:47:02.419370 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 06 10:47:02.419370 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 06 10:47:02.419370 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2e2eb841-906d-4ab2-b15e-63f07cf3037d could not be found. Jun 06 10:47:02.419370 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi Jun 06 10:47:02.419370 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 10:47:02.419370 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi Jun 06 10:47:02.419370 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 10:47:02.419370 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 10:47:02.419370 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 10:47:02.419370 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 10:47:02.419370 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 10:47:02.419370 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2e2eb841-906d-4ab2-b15e-63f07cf3037d could not be found. Jun 06 10:47:02.419370 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi Jun 06 10:47:02.424259 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-dc5dd89e-61cf-426d-bbe8-9950ccea1cfb tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Returning 404 to user: Instance 2e2eb841-906d-4ab2-b15e-63f07cf3037d could not be found. {{(pid=129350) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 10:47:02.426371 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-dc5dd89e-61cf-426d-bbe8-9950ccea1cfb tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] 10.222.0.42 "GET /compute/v2.1/servers/2e2eb841-906d-4ab2-b15e-63f07cf3037d" status: 404 len: 111 microversion: 2.1 time: 0.068362 Jun 06 10:47:02.427612 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 440/897] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:47:02 2022] GET /compute/v2.1/servers/2e2eb841-906d-4ab2-b15e-63f07cf3037d => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 06 10:47:02.436201 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-cad256d2-328a-495f-9adf-ca2ee3dfa2b2 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Calling method '.version_select at 0x7f8fd8427160>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:47:02.446820 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG dbcounter [-] [129349] Writing DB stats nova_api:SELECT=64,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=129349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 10:47:02.479423 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-cad256d2-328a-495f-9adf-ca2ee3dfa2b2 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-414202887" status: 202 len: 0 microversion: 2.1 time: 0.047631 Jun 06 10:47:02.480404 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 458/898] 10.222.0.42 () {58 vars in 1217 bytes} [Mon Jun 6 10:47:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-414202887 => generated 0 bytes in 49 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 06 10:47:03.614098 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-3fb249cb-cacd-4362-bf14-014f3a83570f tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Action: 'create', calling method: .version_select at 0x7f8fd81e0820>, body: {"keypair": {"name": "tempest-keypair-891369921", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJAXVRERyd+tJujGwEnAG1+R3iVEV20rXC+KLYscTWHpDoTxxeAhf/AdgPFFDLEW3kixmm4Jalw1RN/uHz7Tdrw+IeUquK80HjiiNDKTSd92v1YE3id5LRcHnjmZBm8sag=="}} {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 10:47:03.672768 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.quota [None req-3fb249cb-cacd-4362-bf14-014f3a83570f tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Getting quotas for project 92244b4ae17d49bebe621e803bd9ae58. Resources: {'key_pairs'} {{(pid=129350) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 06 10:47:03.682367 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.quota [None req-3fb249cb-cacd-4362-bf14-014f3a83570f tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Getting quotas for user 7ba341ea1ac34874bbfb8b2f713aea1b and project 92244b4ae17d49bebe621e803bd9ae58. Resources: {'key_pairs'} {{(pid=129350) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 06 10:47:03.744702 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-3fb249cb-cacd-4362-bf14-014f3a83570f tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.141808 Jun 06 10:47:03.745533 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 441/899] 10.222.0.42 () {60 vars in 1158 bytes} [Mon Jun 6 10:47:03 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 10:47:05.919817 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-85906a22-1dff-4fac-bc51-11eea5465c6b tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1629173500", "imageRef": "6eea2d98-354d-4083-b74c-abcbb97f9e1a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3bc95a68-dc60-40e7-808c-a65a4ba0072c"}], "security_groups": [{"name": "tempest-securitygroup--1594554262"}], "key_name": "tempest-keypair-891369921", "user_data": "}} {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 10:47:06.097781 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.network.neutron [None req-85906a22-1dff-4fac-bc51-11eea5465c6b tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] validate_networks() for [('3bc95a68-dc60-40e7-808c-a65a4ba0072c', None, None, None, None, None)] {{(pid=129349) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 06 10:47:06.627585 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.virt.hardware [None req-85906a22-1dff-4fac-bc51-11eea5465c6b tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Flavor limits 0:0:0 {{(pid=129349) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 06 10:47:06.628146 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.virt.hardware [None req-85906a22-1dff-4fac-bc51-11eea5465c6b tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Image limits 0:0:0 {{(pid=129349) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 06 10:47:06.628927 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.virt.hardware [None req-85906a22-1dff-4fac-bc51-11eea5465c6b tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Flavor pref 0:0:0 {{(pid=129349) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 06 10:47:06.629416 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.virt.hardware [None req-85906a22-1dff-4fac-bc51-11eea5465c6b tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Image pref 0:0:0 {{(pid=129349) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 06 10:47:06.630033 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.virt.hardware [None req-85906a22-1dff-4fac-bc51-11eea5465c6b tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129349) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 06 10:47:06.644498 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-85906a22-1dff-4fac-bc51-11eea5465c6b tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:47:06.645345 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-85906a22-1dff-4fac-bc51-11eea5465c6b tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:47:06.648559 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-85906a22-1dff-4fac-bc51-11eea5465c6b tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:47:06.649174 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-85906a22-1dff-4fac-bc51-11eea5465c6b tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:47:06.673794 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.quota [None req-85906a22-1dff-4fac-bc51-11eea5465c6b tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Getting quotas for project 92244b4ae17d49bebe621e803bd9ae58. Resources: {'ram', 'cores', 'instances'} {{(pid=129349) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 06 10:47:06.678770 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.quota [None req-85906a22-1dff-4fac-bc51-11eea5465c6b tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Getting quotas for user 7ba341ea1ac34874bbfb8b2f713aea1b and project 92244b4ae17d49bebe621e803bd9ae58. Resources: {'ram', 'cores', 'instances'} {{(pid=129349) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 06 10:47:06.698615 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-85906a22-1dff-4fac-bc51-11eea5465c6b tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Going to run 1 instances... {{(pid=129349) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 06 10:47:06.701234 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-85906a22-1dff-4fac-bc51-11eea5465c6b tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] [instance: 8341de11-491a-48f9-a3ff-2871ec19d297] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6eea2d98-354d-4083-b74c-abcbb97f9e1a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129349) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 06 10:47:06.774368 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-85906a22-1dff-4fac-bc51-11eea5465c6b tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.858825 Jun 06 10:47:06.775576 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 459/900] 10.222.0.42 () {60 vars in 1146 bytes} [Mon Jun 6 10:47:05 2022] POST /compute/v2.1/servers => generated 402 bytes in 861 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 06 10:47:06.787146 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-833a4568-7da5-4001-b6db-3a6d77879e41 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:47:06.788552 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-833a4568-7da5-4001-b6db-3a6d77879e41 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] [instance: 8341de11-491a-48f9-a3ff-2871ec19d297] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:47:06.873904 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-833a4568-7da5-4001-b6db-3a6d77879e41 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ba341ea1ac34874bbfb8b2f713aea1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92244b4ae17d49bebe621e803bd9ae58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:47:06.882215 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-833a4568-7da5-4001-b6db-3a6d77879e41 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] 10.222.0.42 "GET /compute/v2.1/servers/8341de11-491a-48f9-a3ff-2871ec19d297" status: 200 len: 1241 microversion: 2.1 time: 0.100140 Jun 06 10:47:06.882789 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 442/901] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:47:06 2022] GET /compute/v2.1/servers/8341de11-491a-48f9-a3ff-2871ec19d297 => generated 1241 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:47:07.206322 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-f10f345a-49a0-4156-9cb6-b8d74744eb81 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Action: 'create', calling method: .version_select at 0x7f8fd81e7dc0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1544406201", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDQOuf19NYEWXZFEE6SA9OPTyPooQ2ayKogoiq7EwFl5T3AEnbOtpgm2Y/mIvp7gmqxxAyXtxrkZ+5chN/MzTdqHww5dsjLLiPNOSqfNRaxQZ2PaofuNjDiJVE7Dyz3dBw=="}} {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 10:47:07.225611 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.quota [None req-f10f345a-49a0-4156-9cb6-b8d74744eb81 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Getting quotas for project 6983c51eda664586ba62e206acfcc2d9. Resources: {'key_pairs'} {{(pid=129349) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 06 10:47:07.234180 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.quota [None req-f10f345a-49a0-4156-9cb6-b8d74744eb81 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Getting quotas for user 8a7a5a9773d84145bbf611439d025dd8 and project 6983c51eda664586ba62e206acfcc2d9. Resources: {'key_pairs'} {{(pid=129349) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 06 10:47:07.263642 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-f10f345a-49a0-4156-9cb6-b8d74744eb81 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.302034 Jun 06 10:47:07.264906 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 460/902] 10.222.0.42 () {60 vars in 1158 bytes} [Mon Jun 6 10:47:06 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 10:47:07.901587 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-c256ae9c-d7f9-43fe-b2b7-c6f67257c9fd tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:47:07.902201 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-c256ae9c-d7f9-43fe-b2b7-c6f67257c9fd tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] [instance: 8341de11-491a-48f9-a3ff-2871ec19d297] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:47:07.908816 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-c256ae9c-d7f9-43fe-b2b7-c6f67257c9fd tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:47:07.909783 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-c256ae9c-d7f9-43fe-b2b7-c6f67257c9fd tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:47:07.910753 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-c256ae9c-d7f9-43fe-b2b7-c6f67257c9fd tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:47:07.911347 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-c256ae9c-d7f9-43fe-b2b7-c6f67257c9fd tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:47:08.013643 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-c256ae9c-d7f9-43fe-b2b7-c6f67257c9fd tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ba341ea1ac34874bbfb8b2f713aea1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92244b4ae17d49bebe621e803bd9ae58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:47:08.022032 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-c256ae9c-d7f9-43fe-b2b7-c6f67257c9fd tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] 10.222.0.42 "GET /compute/v2.1/servers/8341de11-491a-48f9-a3ff-2871ec19d297" status: 200 len: 1311 microversion: 2.1 time: 0.125225 Jun 06 10:47:08.023100 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 443/903] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:47:07 2022] GET /compute/v2.1/servers/8341de11-491a-48f9-a3ff-2871ec19d297 => generated 1311 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:47:09.041911 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-aaf0111d-1dad-4724-bad5-0ae88aa07284 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:47:09.043309 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-aaf0111d-1dad-4724-bad5-0ae88aa07284 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] [instance: 8341de11-491a-48f9-a3ff-2871ec19d297] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:47:09.057733 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-aaf0111d-1dad-4724-bad5-0ae88aa07284 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:47:09.058372 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-aaf0111d-1dad-4724-bad5-0ae88aa07284 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:47:09.059345 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-aaf0111d-1dad-4724-bad5-0ae88aa07284 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:47:09.060419 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-aaf0111d-1dad-4724-bad5-0ae88aa07284 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:47:09.310502 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-aaf0111d-1dad-4724-bad5-0ae88aa07284 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ba341ea1ac34874bbfb8b2f713aea1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92244b4ae17d49bebe621e803bd9ae58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:47:09.325542 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-aaf0111d-1dad-4724-bad5-0ae88aa07284 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] 10.222.0.42 "GET /compute/v2.1/servers/8341de11-491a-48f9-a3ff-2871ec19d297" status: 200 len: 1367 microversion: 2.1 time: 0.288711 Jun 06 10:47:09.326380 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 461/904] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:47:09 2022] GET /compute/v2.1/servers/8341de11-491a-48f9-a3ff-2871ec19d297 => generated 1367 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:47:09.723063 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [req-744dba89-b70d-4f97-8fd2-c5c81d45bd27 req-876ae8e7-23ae-4036-befc-ca13ffd9ec2a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8341de11-491a-48f9-a3ff-2871ec19d297", "tag": "319cb990-8084-43f8-b630-21d54163fe9b"}]} {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 10:47:09.758305 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [req-744dba89-b70d-4f97-8fd2-c5c81d45bd27 req-876ae8e7-23ae-4036-befc-ca13ffd9ec2a service nova] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:47:09.758760 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [req-744dba89-b70d-4f97-8fd2-c5c81d45bd27 req-876ae8e7-23ae-4036-befc-ca13ffd9ec2a service nova] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:47:09.791936 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.compute.server_external_events [req-744dba89-b70d-4f97-8fd2-c5c81d45bd27 req-876ae8e7-23ae-4036-befc-ca13ffd9ec2a service nova] Creating event network-changed:319cb990-8084-43f8-b630-21d54163fe9b for instance 8341de11-491a-48f9-a3ff-2871ec19d297 on hv-cinder-84482 Jun 06 10:47:09.807704 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [req-744dba89-b70d-4f97-8fd2-c5c81d45bd27 req-876ae8e7-23ae-4036-befc-ca13ffd9ec2a service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083462 Jun 06 10:47:09.809023 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 444/905] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Jun 6 10:47:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 10:47:10.344418 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-8d8b5c7f-155f-4f39-be62-e57d094eac2a tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:47:10.345040 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-8d8b5c7f-155f-4f39-be62-e57d094eac2a tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] [instance: 8341de11-491a-48f9-a3ff-2871ec19d297] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:47:10.351914 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-8d8b5c7f-155f-4f39-be62-e57d094eac2a tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:47:10.352361 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-8d8b5c7f-155f-4f39-be62-e57d094eac2a tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:47:10.353140 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-8d8b5c7f-155f-4f39-be62-e57d094eac2a tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:47:10.353572 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-8d8b5c7f-155f-4f39-be62-e57d094eac2a tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:47:10.495705 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-8d8b5c7f-155f-4f39-be62-e57d094eac2a tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ba341ea1ac34874bbfb8b2f713aea1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92244b4ae17d49bebe621e803bd9ae58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:47:10.504228 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-8d8b5c7f-155f-4f39-be62-e57d094eac2a tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] 10.222.0.42 "GET /compute/v2.1/servers/8341de11-491a-48f9-a3ff-2871ec19d297" status: 200 len: 1367 microversion: 2.1 time: 0.163507 Jun 06 10:47:10.504882 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 462/906] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:47:10 2022] GET /compute/v2.1/servers/8341de11-491a-48f9-a3ff-2871ec19d297 => generated 1367 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:47:11.522590 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-300635a4-43dc-4dbe-aa84-5eccc91c4af4 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:47:11.523287 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-300635a4-43dc-4dbe-aa84-5eccc91c4af4 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] [instance: 8341de11-491a-48f9-a3ff-2871ec19d297] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:47:11.529435 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-300635a4-43dc-4dbe-aa84-5eccc91c4af4 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:47:11.529875 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-300635a4-43dc-4dbe-aa84-5eccc91c4af4 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:47:11.530628 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-300635a4-43dc-4dbe-aa84-5eccc91c4af4 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:47:11.531056 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-300635a4-43dc-4dbe-aa84-5eccc91c4af4 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:47:11.669459 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-300635a4-43dc-4dbe-aa84-5eccc91c4af4 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ba341ea1ac34874bbfb8b2f713aea1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92244b4ae17d49bebe621e803bd9ae58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:47:11.678276 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-300635a4-43dc-4dbe-aa84-5eccc91c4af4 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] 10.222.0.42 "GET /compute/v2.1/servers/8341de11-491a-48f9-a3ff-2871ec19d297" status: 200 len: 1367 microversion: 2.1 time: 0.160895 Jun 06 10:47:11.678939 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 445/907] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:47:11 2022] GET /compute/v2.1/servers/8341de11-491a-48f9-a3ff-2871ec19d297 => generated 1367 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:47:12.695425 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-005864a1-2ab1-4bef-9eae-75d426a36164 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:47:12.696082 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-005864a1-2ab1-4bef-9eae-75d426a36164 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] [instance: 8341de11-491a-48f9-a3ff-2871ec19d297] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:47:12.702539 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-005864a1-2ab1-4bef-9eae-75d426a36164 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:47:12.702987 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-005864a1-2ab1-4bef-9eae-75d426a36164 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:47:12.703758 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-005864a1-2ab1-4bef-9eae-75d426a36164 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:47:12.704219 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-005864a1-2ab1-4bef-9eae-75d426a36164 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:47:12.844988 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-005864a1-2ab1-4bef-9eae-75d426a36164 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ba341ea1ac34874bbfb8b2f713aea1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92244b4ae17d49bebe621e803bd9ae58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:47:12.853838 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-005864a1-2ab1-4bef-9eae-75d426a36164 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] 10.222.0.42 "GET /compute/v2.1/servers/8341de11-491a-48f9-a3ff-2871ec19d297" status: 200 len: 1367 microversion: 2.1 time: 0.162455 Jun 06 10:47:12.854420 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 463/908] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:47:12 2022] GET /compute/v2.1/servers/8341de11-491a-48f9-a3ff-2871ec19d297 => generated 1367 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:47:13.870481 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-8b1746e7-49e4-4905-a9db-362aa7fb46a6 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:47:13.871209 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-8b1746e7-49e4-4905-a9db-362aa7fb46a6 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] [instance: 8341de11-491a-48f9-a3ff-2871ec19d297] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:47:13.878561 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-8b1746e7-49e4-4905-a9db-362aa7fb46a6 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:47:13.879007 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-8b1746e7-49e4-4905-a9db-362aa7fb46a6 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:47:13.879798 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-8b1746e7-49e4-4905-a9db-362aa7fb46a6 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:47:13.880235 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-8b1746e7-49e4-4905-a9db-362aa7fb46a6 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:47:14.032244 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-8b1746e7-49e4-4905-a9db-362aa7fb46a6 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ba341ea1ac34874bbfb8b2f713aea1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92244b4ae17d49bebe621e803bd9ae58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:47:14.040997 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-8b1746e7-49e4-4905-a9db-362aa7fb46a6 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] 10.222.0.42 "GET /compute/v2.1/servers/8341de11-491a-48f9-a3ff-2871ec19d297" status: 200 len: 1367 microversion: 2.1 time: 0.174370 Jun 06 10:47:14.041562 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 446/909] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:47:13 2022] GET /compute/v2.1/servers/8341de11-491a-48f9-a3ff-2871ec19d297 => generated 1367 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:47:14.838279 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [req-15f421a6-eef0-4c5f-b279-8d19a9a42099 req-7e9f2cba-f8ad-42d7-9b36-d708ec50e1d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8341de11-491a-48f9-a3ff-2871ec19d297", "name": "network-vif-plugged", "status": "completed", "tag": "319cb990-8084-43f8-b630-21d54163fe9b"}]} {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 10:47:14.847876 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [req-15f421a6-eef0-4c5f-b279-8d19a9a42099 req-7e9f2cba-f8ad-42d7-9b36-d708ec50e1d0 service nova] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:47:14.848468 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [req-15f421a6-eef0-4c5f-b279-8d19a9a42099 req-7e9f2cba-f8ad-42d7-9b36-d708ec50e1d0 service nova] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:47:14.862639 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.compute.server_external_events [req-15f421a6-eef0-4c5f-b279-8d19a9a42099 req-7e9f2cba-f8ad-42d7-9b36-d708ec50e1d0 service nova] Creating event network-vif-plugged:319cb990-8084-43f8-b630-21d54163fe9b for instance 8341de11-491a-48f9-a3ff-2871ec19d297 on hv-cinder-84482 Jun 06 10:47:14.867638 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [req-15f421a6-eef0-4c5f-b279-8d19a9a42099 req-7e9f2cba-f8ad-42d7-9b36-d708ec50e1d0 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033033 Jun 06 10:47:14.868388 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 464/910] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Jun 6 10:47:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 10:47:15.062472 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-8d6435bf-5b94-4b65-9321-26e20c8aaab6 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:47:15.063217 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-8d6435bf-5b94-4b65-9321-26e20c8aaab6 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] [instance: 8341de11-491a-48f9-a3ff-2871ec19d297] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:47:15.070311 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-8d6435bf-5b94-4b65-9321-26e20c8aaab6 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:47:15.070759 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-8d6435bf-5b94-4b65-9321-26e20c8aaab6 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:47:15.071625 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-8d6435bf-5b94-4b65-9321-26e20c8aaab6 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:47:15.072098 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-8d6435bf-5b94-4b65-9321-26e20c8aaab6 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:47:15.207529 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-8d6435bf-5b94-4b65-9321-26e20c8aaab6 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ba341ea1ac34874bbfb8b2f713aea1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92244b4ae17d49bebe621e803bd9ae58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:47:15.215012 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-8d6435bf-5b94-4b65-9321-26e20c8aaab6 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] 10.222.0.42 "GET /compute/v2.1/servers/8341de11-491a-48f9-a3ff-2871ec19d297" status: 200 len: 1367 microversion: 2.1 time: 0.156465 Jun 06 10:47:15.215516 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 447/911] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:47:15 2022] GET /compute/v2.1/servers/8341de11-491a-48f9-a3ff-2871ec19d297 => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:47:16.232958 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-7a784d5d-8892-466e-89d3-59f1cb88f73f tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:47:16.233686 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-7a784d5d-8892-466e-89d3-59f1cb88f73f tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] [instance: 8341de11-491a-48f9-a3ff-2871ec19d297] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:47:16.239924 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-7a784d5d-8892-466e-89d3-59f1cb88f73f tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:47:16.240373 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-7a784d5d-8892-466e-89d3-59f1cb88f73f tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:47:16.241164 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-7a784d5d-8892-466e-89d3-59f1cb88f73f tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:47:16.241601 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-7a784d5d-8892-466e-89d3-59f1cb88f73f tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:47:16.389121 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-7a784d5d-8892-466e-89d3-59f1cb88f73f tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ba341ea1ac34874bbfb8b2f713aea1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92244b4ae17d49bebe621e803bd9ae58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:47:16.397572 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-7a784d5d-8892-466e-89d3-59f1cb88f73f tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] 10.222.0.42 "GET /compute/v2.1/servers/8341de11-491a-48f9-a3ff-2871ec19d297" status: 200 len: 1367 microversion: 2.1 time: 0.169289 Jun 06 10:47:16.398704 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 465/912] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:47:16 2022] GET /compute/v2.1/servers/8341de11-491a-48f9-a3ff-2871ec19d297 => generated 1367 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:47:17.414408 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-d2cc321a-e99c-45d8-891a-bffd1d6b644a tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:47:17.415018 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-d2cc321a-e99c-45d8-891a-bffd1d6b644a tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] [instance: 8341de11-491a-48f9-a3ff-2871ec19d297] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:47:17.417480 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG dbcounter [-] [129350] Writing DB stats nova_cell0:SELECT=6 {{(pid=129350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 10:47:17.422976 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-d2cc321a-e99c-45d8-891a-bffd1d6b644a tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:47:17.423424 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-d2cc321a-e99c-45d8-891a-bffd1d6b644a tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:47:17.424203 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-d2cc321a-e99c-45d8-891a-bffd1d6b644a tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:47:17.425246 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-d2cc321a-e99c-45d8-891a-bffd1d6b644a tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:47:17.560182 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-d2cc321a-e99c-45d8-891a-bffd1d6b644a tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ba341ea1ac34874bbfb8b2f713aea1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92244b4ae17d49bebe621e803bd9ae58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:47:17.568898 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-d2cc321a-e99c-45d8-891a-bffd1d6b644a tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] 10.222.0.42 "GET /compute/v2.1/servers/8341de11-491a-48f9-a3ff-2871ec19d297" status: 200 len: 1557 microversion: 2.1 time: 0.158307 Jun 06 10:47:17.569456 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 448/913] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:47:17 2022] GET /compute/v2.1/servers/8341de11-491a-48f9-a3ff-2871ec19d297 => generated 1557 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:47:17.585811 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-1c1e947a-93fc-468d-b796-c8af32e09ac2 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:47:17.586317 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-1c1e947a-93fc-468d-b796-c8af32e09ac2 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] [instance: 8341de11-491a-48f9-a3ff-2871ec19d297] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:47:17.588263 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG dbcounter [-] [129349] Writing DB stats nova_cell0:SELECT=2 {{(pid=129349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 10:47:17.589436 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG dbcounter [-] [129349] Writing DB stats nova_cell0:SELECT=10 {{(pid=129349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 10:47:17.595361 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-1c1e947a-93fc-468d-b796-c8af32e09ac2 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:47:17.595831 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-1c1e947a-93fc-468d-b796-c8af32e09ac2 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:47:17.596891 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-1c1e947a-93fc-468d-b796-c8af32e09ac2 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:47:17.597333 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-1c1e947a-93fc-468d-b796-c8af32e09ac2 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:47:17.678199 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-1c1e947a-93fc-468d-b796-c8af32e09ac2 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] 10.222.0.42 "GET /compute/v2.1/servers/8341de11-491a-48f9-a3ff-2871ec19d297/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.096240 Jun 06 10:47:17.678801 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 466/914] 10.222.0.42 () {58 vars in 1274 bytes} [Mon Jun 6 10:47:17 2022] GET /compute/v2.1/servers/8341de11-491a-48f9-a3ff-2871ec19d297/os-interface => generated 285 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 10:47:18.871762 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [req-3a649f27-71da-437a-8a87-b3afe8f7dc1c req-5fde6789-bfd2-4aa0-81cb-35144ea2e8c4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8341de11-491a-48f9-a3ff-2871ec19d297", "tag": "319cb990-8084-43f8-b630-21d54163fe9b"}]} {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 10:47:18.881031 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [req-3a649f27-71da-437a-8a87-b3afe8f7dc1c req-5fde6789-bfd2-4aa0-81cb-35144ea2e8c4 service nova] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:47:18.881464 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [req-3a649f27-71da-437a-8a87-b3afe8f7dc1c req-5fde6789-bfd2-4aa0-81cb-35144ea2e8c4 service nova] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:47:18.892523 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.compute.server_external_events [req-3a649f27-71da-437a-8a87-b3afe8f7dc1c req-5fde6789-bfd2-4aa0-81cb-35144ea2e8c4 service nova] Creating event network-changed:319cb990-8084-43f8-b630-21d54163fe9b for instance 8341de11-491a-48f9-a3ff-2871ec19d297 on hv-cinder-84482 Jun 06 10:47:18.898630 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [req-3a649f27-71da-437a-8a87-b3afe8f7dc1c req-5fde6789-bfd2-4aa0-81cb-35144ea2e8c4 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030445 Jun 06 10:47:18.899152 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 449/915] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Jun 6 10:47:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 10:47:24.039265 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-c50ca35f-9bc1-4f68-87b3-e7fae20a04c6 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1953472189", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1544406201", "security_groups": [{"name": "tempest-secgroup-smoke-2130332908"}], "block_device_mapping_v2": [{"uuid": "b903ecb5-7213-4cf9-86ab-b9ec46e871db", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "9c358abd-588b-47b2-9ff6-6faded31ee83"}]}} {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 10:47:24.148799 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.network.neutron [None req-c50ca35f-9bc1-4f68-87b3-e7fae20a04c6 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] validate_networks() for [('9c358abd-588b-47b2-9ff6-6faded31ee83', None, None, None, None, None)] {{(pid=129349) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 06 10:47:24.509399 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.virt.hardware [None req-c50ca35f-9bc1-4f68-87b3-e7fae20a04c6 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Flavor limits 0:0:0 {{(pid=129349) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 06 10:47:24.509798 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.virt.hardware [None req-c50ca35f-9bc1-4f68-87b3-e7fae20a04c6 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Image limits 0:0:0 {{(pid=129349) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 06 10:47:24.510264 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.virt.hardware [None req-c50ca35f-9bc1-4f68-87b3-e7fae20a04c6 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Flavor pref 0:0:0 {{(pid=129349) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 06 10:47:24.510702 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.virt.hardware [None req-c50ca35f-9bc1-4f68-87b3-e7fae20a04c6 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Image pref 0:0:0 {{(pid=129349) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 06 10:47:24.511101 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.virt.hardware [None req-c50ca35f-9bc1-4f68-87b3-e7fae20a04c6 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129349) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 06 10:47:24.520861 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-c50ca35f-9bc1-4f68-87b3-e7fae20a04c6 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:47:24.521313 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-c50ca35f-9bc1-4f68-87b3-e7fae20a04c6 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:47:24.522099 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-c50ca35f-9bc1-4f68-87b3-e7fae20a04c6 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:47:24.522526 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-c50ca35f-9bc1-4f68-87b3-e7fae20a04c6 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:47:24.539114 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.quota [None req-c50ca35f-9bc1-4f68-87b3-e7fae20a04c6 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Getting quotas for project 6983c51eda664586ba62e206acfcc2d9. Resources: {'ram', 'cores', 'instances'} {{(pid=129349) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 06 10:47:24.542990 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.quota [None req-c50ca35f-9bc1-4f68-87b3-e7fae20a04c6 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Getting quotas for user 8a7a5a9773d84145bbf611439d025dd8 and project 6983c51eda664586ba62e206acfcc2d9. Resources: {'ram', 'cores', 'instances'} {{(pid=129349) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 06 10:47:24.599380 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-c50ca35f-9bc1-4f68-87b3-e7fae20a04c6 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Going to run 1 instances... {{(pid=129349) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 06 10:47:24.601470 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-c50ca35f-9bc1-4f68-87b3-e7fae20a04c6 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] [instance: 544fc9bb-04f0-453c-a7bb-962f01ed2dd8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='b903ecb5-7213-4cf9-86ab-b9ec46e871db',volume_size=None,volume_type=None)] {{(pid=129349) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 06 10:47:24.719087 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-c50ca35f-9bc1-4f68-87b3-e7fae20a04c6 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.684313 Jun 06 10:47:24.719731 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 467/916] 10.222.0.42 () {60 vars in 1146 bytes} [Mon Jun 6 10:47:24 2022] POST /compute/v2.1/servers => generated 406 bytes in 686 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 06 10:47:24.731007 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-896f1ebc-af39-4aa3-a914-5b1da175135a tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:47:24.731732 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-896f1ebc-af39-4aa3-a914-5b1da175135a tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] [instance: 544fc9bb-04f0-453c-a7bb-962f01ed2dd8] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:47:24.790559 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-896f1ebc-af39-4aa3-a914-5b1da175135a tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a7a5a9773d84145bbf611439d025dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6983c51eda664586ba62e206acfcc2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:47:24.797234 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-896f1ebc-af39-4aa3-a914-5b1da175135a tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] 10.222.0.42 "GET /compute/v2.1/servers/544fc9bb-04f0-453c-a7bb-962f01ed2dd8" status: 200 len: 1095 microversion: 2.1 time: 0.071060 Jun 06 10:47:24.797792 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 450/917] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:47:24 2022] GET /compute/v2.1/servers/544fc9bb-04f0-453c-a7bb-962f01ed2dd8 => generated 1095 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:47:25.815026 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-1e4b7831-c7af-462e-bb54-609934e407dc tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:47:25.815648 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-1e4b7831-c7af-462e-bb54-609934e407dc tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] [instance: 544fc9bb-04f0-453c-a7bb-962f01ed2dd8] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:47:25.822403 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-1e4b7831-c7af-462e-bb54-609934e407dc tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:47:25.822884 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-1e4b7831-c7af-462e-bb54-609934e407dc tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:47:25.823668 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-1e4b7831-c7af-462e-bb54-609934e407dc tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:47:25.824128 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-1e4b7831-c7af-462e-bb54-609934e407dc tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:47:25.889352 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-1e4b7831-c7af-462e-bb54-609934e407dc tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a7a5a9773d84145bbf611439d025dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6983c51eda664586ba62e206acfcc2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:47:25.897917 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-1e4b7831-c7af-462e-bb54-609934e407dc tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] 10.222.0.42 "GET /compute/v2.1/servers/544fc9bb-04f0-453c-a7bb-962f01ed2dd8" status: 200 len: 1211 microversion: 2.1 time: 0.087240 Jun 06 10:47:25.898486 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 468/918] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:47:25 2022] GET /compute/v2.1/servers/544fc9bb-04f0-453c-a7bb-962f01ed2dd8 => generated 1211 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:47:26.914484 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-f6704224-a79f-4435-9247-3f456a1153c8 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:47:26.915097 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-f6704224-a79f-4435-9247-3f456a1153c8 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] [instance: 544fc9bb-04f0-453c-a7bb-962f01ed2dd8] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:47:26.922359 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-f6704224-a79f-4435-9247-3f456a1153c8 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:47:26.922805 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-f6704224-a79f-4435-9247-3f456a1153c8 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:47:26.923571 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-f6704224-a79f-4435-9247-3f456a1153c8 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:47:26.924032 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-f6704224-a79f-4435-9247-3f456a1153c8 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:47:26.927268 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG dbcounter [-] [129350] Writing DB stats nova_cell1:SELECT=54,nova_cell1:INSERT=1 {{(pid=129350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 10:47:27.077963 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-f6704224-a79f-4435-9247-3f456a1153c8 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a7a5a9773d84145bbf611439d025dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6983c51eda664586ba62e206acfcc2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:47:27.086604 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-f6704224-a79f-4435-9247-3f456a1153c8 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] 10.222.0.42 "GET /compute/v2.1/servers/544fc9bb-04f0-453c-a7bb-962f01ed2dd8" status: 200 len: 1267 microversion: 2.1 time: 0.175892 Jun 06 10:47:27.087188 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 451/919] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:47:26 2022] GET /compute/v2.1/servers/544fc9bb-04f0-453c-a7bb-962f01ed2dd8 => generated 1267 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:47:27.213403 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [req-60c9d211-1d15-4692-b861-881e44fdd4f1 req-2a90283a-da97-4550-800c-a813e7fc1ed8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "544fc9bb-04f0-453c-a7bb-962f01ed2dd8", "tag": "8abb5193-66bd-4d14-8ab2-9e216f171f63"}]} {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 10:47:27.233353 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [req-60c9d211-1d15-4692-b861-881e44fdd4f1 req-2a90283a-da97-4550-800c-a813e7fc1ed8 service nova] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:47:27.233807 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [req-60c9d211-1d15-4692-b861-881e44fdd4f1 req-2a90283a-da97-4550-800c-a813e7fc1ed8 service nova] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:47:27.237012 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG dbcounter [-] [129349] Writing DB stats nova_cell1:SELECT=77,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 10:47:27.249152 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.compute.server_external_events [req-60c9d211-1d15-4692-b861-881e44fdd4f1 req-2a90283a-da97-4550-800c-a813e7fc1ed8 service nova] Creating event network-changed:8abb5193-66bd-4d14-8ab2-9e216f171f63 for instance 544fc9bb-04f0-453c-a7bb-962f01ed2dd8 on hv-cinder-84482 Jun 06 10:47:27.255447 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [req-60c9d211-1d15-4692-b861-881e44fdd4f1 req-2a90283a-da97-4550-800c-a813e7fc1ed8 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045952 Jun 06 10:47:27.256083 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 469/920] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Jun 6 10:47:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 10:47:28.103984 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-d5216746-f19c-41c5-b8f3-5a7680446e45 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:47:28.104695 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-d5216746-f19c-41c5-b8f3-5a7680446e45 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] [instance: 544fc9bb-04f0-453c-a7bb-962f01ed2dd8] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:47:28.111419 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-d5216746-f19c-41c5-b8f3-5a7680446e45 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:47:28.112510 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-d5216746-f19c-41c5-b8f3-5a7680446e45 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:47:28.113293 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-d5216746-f19c-41c5-b8f3-5a7680446e45 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:47:28.113729 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-d5216746-f19c-41c5-b8f3-5a7680446e45 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:47:28.245591 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-d5216746-f19c-41c5-b8f3-5a7680446e45 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a7a5a9773d84145bbf611439d025dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6983c51eda664586ba62e206acfcc2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:47:28.253776 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-d5216746-f19c-41c5-b8f3-5a7680446e45 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] 10.222.0.42 "GET /compute/v2.1/servers/544fc9bb-04f0-453c-a7bb-962f01ed2dd8" status: 200 len: 1267 microversion: 2.1 time: 0.154145 Jun 06 10:47:28.254461 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 452/921] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:47:28 2022] GET /compute/v2.1/servers/544fc9bb-04f0-453c-a7bb-962f01ed2dd8 => generated 1267 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:47:29.271767 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-25d8bd12-1bac-4646-be83-7a47cb9eee29 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:47:29.272495 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-25d8bd12-1bac-4646-be83-7a47cb9eee29 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] [instance: 544fc9bb-04f0-453c-a7bb-962f01ed2dd8] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:47:29.280522 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-25d8bd12-1bac-4646-be83-7a47cb9eee29 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:47:29.280969 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-25d8bd12-1bac-4646-be83-7a47cb9eee29 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:47:29.281735 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-25d8bd12-1bac-4646-be83-7a47cb9eee29 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:47:29.282170 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-25d8bd12-1bac-4646-be83-7a47cb9eee29 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:47:29.420789 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-25d8bd12-1bac-4646-be83-7a47cb9eee29 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a7a5a9773d84145bbf611439d025dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6983c51eda664586ba62e206acfcc2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:47:29.428637 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-25d8bd12-1bac-4646-be83-7a47cb9eee29 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] 10.222.0.42 "GET /compute/v2.1/servers/544fc9bb-04f0-453c-a7bb-962f01ed2dd8" status: 200 len: 1267 microversion: 2.1 time: 0.161893 Jun 06 10:47:29.429199 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 470/922] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:47:29 2022] GET /compute/v2.1/servers/544fc9bb-04f0-453c-a7bb-962f01ed2dd8 => generated 1267 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:47:30.445933 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-e1640713-d7b1-4148-be72-eb305ed15b3d tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:47:30.446553 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-e1640713-d7b1-4148-be72-eb305ed15b3d tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] [instance: 544fc9bb-04f0-453c-a7bb-962f01ed2dd8] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:47:30.453016 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-e1640713-d7b1-4148-be72-eb305ed15b3d tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:47:30.453466 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-e1640713-d7b1-4148-be72-eb305ed15b3d tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:47:30.454249 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-e1640713-d7b1-4148-be72-eb305ed15b3d tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:47:30.454671 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-e1640713-d7b1-4148-be72-eb305ed15b3d tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:47:30.583120 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-e1640713-d7b1-4148-be72-eb305ed15b3d tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a7a5a9773d84145bbf611439d025dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6983c51eda664586ba62e206acfcc2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:47:30.590732 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-e1640713-d7b1-4148-be72-eb305ed15b3d tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] 10.222.0.42 "GET /compute/v2.1/servers/544fc9bb-04f0-453c-a7bb-962f01ed2dd8" status: 200 len: 1267 microversion: 2.1 time: 0.148651 Jun 06 10:47:30.591296 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 453/923] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:47:30 2022] GET /compute/v2.1/servers/544fc9bb-04f0-453c-a7bb-962f01ed2dd8 => generated 1267 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:47:31.607399 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-2ced4b41-db26-4b83-bed2-eec2b2baf835 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:47:31.608059 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-2ced4b41-db26-4b83-bed2-eec2b2baf835 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] [instance: 544fc9bb-04f0-453c-a7bb-962f01ed2dd8] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:47:31.614652 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-2ced4b41-db26-4b83-bed2-eec2b2baf835 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:47:31.615095 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-2ced4b41-db26-4b83-bed2-eec2b2baf835 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:47:31.615882 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-2ced4b41-db26-4b83-bed2-eec2b2baf835 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:47:31.616316 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-2ced4b41-db26-4b83-bed2-eec2b2baf835 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:47:31.748043 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-2ced4b41-db26-4b83-bed2-eec2b2baf835 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a7a5a9773d84145bbf611439d025dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6983c51eda664586ba62e206acfcc2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:47:31.756782 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-2ced4b41-db26-4b83-bed2-eec2b2baf835 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] 10.222.0.42 "GET /compute/v2.1/servers/544fc9bb-04f0-453c-a7bb-962f01ed2dd8" status: 200 len: 1267 microversion: 2.1 time: 0.153389 Jun 06 10:47:31.757339 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 471/924] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:47:31 2022] GET /compute/v2.1/servers/544fc9bb-04f0-453c-a7bb-962f01ed2dd8 => generated 1267 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:47:32.773993 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-1ef3f6ec-dade-471b-afe7-279db8388814 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:47:32.774590 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-1ef3f6ec-dade-471b-afe7-279db8388814 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] [instance: 544fc9bb-04f0-453c-a7bb-962f01ed2dd8] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:47:32.780982 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-1ef3f6ec-dade-471b-afe7-279db8388814 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:47:32.781425 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-1ef3f6ec-dade-471b-afe7-279db8388814 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:47:32.782172 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-1ef3f6ec-dade-471b-afe7-279db8388814 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:47:32.782597 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-1ef3f6ec-dade-471b-afe7-279db8388814 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:47:32.910869 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-1ef3f6ec-dade-471b-afe7-279db8388814 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a7a5a9773d84145bbf611439d025dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6983c51eda664586ba62e206acfcc2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:47:32.918545 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-1ef3f6ec-dade-471b-afe7-279db8388814 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] 10.222.0.42 "GET /compute/v2.1/servers/544fc9bb-04f0-453c-a7bb-962f01ed2dd8" status: 200 len: 1267 microversion: 2.1 time: 0.148565 Jun 06 10:47:32.919106 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 454/925] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:47:32 2022] GET /compute/v2.1/servers/544fc9bb-04f0-453c-a7bb-962f01ed2dd8 => generated 1267 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:47:33.935717 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-2786f3ca-5253-4700-9534-4879a975d732 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:47:33.936398 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-2786f3ca-5253-4700-9534-4879a975d732 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] [instance: 544fc9bb-04f0-453c-a7bb-962f01ed2dd8] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:47:33.943525 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-2786f3ca-5253-4700-9534-4879a975d732 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:47:33.944022 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-2786f3ca-5253-4700-9534-4879a975d732 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:47:33.944814 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-2786f3ca-5253-4700-9534-4879a975d732 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:47:33.945247 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-2786f3ca-5253-4700-9534-4879a975d732 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:47:34.076640 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-2786f3ca-5253-4700-9534-4879a975d732 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a7a5a9773d84145bbf611439d025dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6983c51eda664586ba62e206acfcc2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:47:34.085112 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-2786f3ca-5253-4700-9534-4879a975d732 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] 10.222.0.42 "GET /compute/v2.1/servers/544fc9bb-04f0-453c-a7bb-962f01ed2dd8" status: 200 len: 1267 microversion: 2.1 time: 0.153237 Jun 06 10:47:34.085711 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 472/926] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:47:33 2022] GET /compute/v2.1/servers/544fc9bb-04f0-453c-a7bb-962f01ed2dd8 => generated 1267 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:47:35.102842 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-90369f50-b4f0-4cf5-9fcd-8fdaee011c96 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:47:35.103423 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-90369f50-b4f0-4cf5-9fcd-8fdaee011c96 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] [instance: 544fc9bb-04f0-453c-a7bb-962f01ed2dd8] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:47:35.105814 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG dbcounter [-] [129350] Writing DB stats nova_cell0:SELECT=2 {{(pid=129350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 10:47:35.106453 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG dbcounter [-] [129350] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=1 {{(pid=129350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 10:47:35.112037 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-90369f50-b4f0-4cf5-9fcd-8fdaee011c96 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:47:35.112484 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-90369f50-b4f0-4cf5-9fcd-8fdaee011c96 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:47:35.113254 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-90369f50-b4f0-4cf5-9fcd-8fdaee011c96 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:47:35.113688 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-90369f50-b4f0-4cf5-9fcd-8fdaee011c96 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:47:35.247716 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-90369f50-b4f0-4cf5-9fcd-8fdaee011c96 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a7a5a9773d84145bbf611439d025dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6983c51eda664586ba62e206acfcc2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:47:35.256051 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-90369f50-b4f0-4cf5-9fcd-8fdaee011c96 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] 10.222.0.42 "GET /compute/v2.1/servers/544fc9bb-04f0-453c-a7bb-962f01ed2dd8" status: 200 len: 1267 microversion: 2.1 time: 0.157269 Jun 06 10:47:35.256608 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 455/927] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:47:35 2022] GET /compute/v2.1/servers/544fc9bb-04f0-453c-a7bb-962f01ed2dd8 => generated 1267 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:47:36.273692 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-7e83e731-5a5f-416a-9cff-f7abc4238c6c tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:47:36.274276 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-7e83e731-5a5f-416a-9cff-f7abc4238c6c tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] [instance: 544fc9bb-04f0-453c-a7bb-962f01ed2dd8] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:47:36.276167 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG dbcounter [-] [129349] Writing DB stats nova_cell0:SELECT=2 {{(pid=129349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 10:47:36.276934 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG dbcounter [-] [129349] Writing DB stats nova_cell0:SELECT=6 {{(pid=129349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 10:47:36.278118 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG dbcounter [-] [129349] Writing DB stats nova_api:SELECT=66,nova_api:DELETE=1,nova_api:INSERT=7 {{(pid=129349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 10:47:36.285220 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-7e83e731-5a5f-416a-9cff-f7abc4238c6c tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:47:36.285669 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-7e83e731-5a5f-416a-9cff-f7abc4238c6c tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:47:36.286439 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-7e83e731-5a5f-416a-9cff-f7abc4238c6c tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:47:36.286873 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-7e83e731-5a5f-416a-9cff-f7abc4238c6c tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:47:36.420600 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-7e83e731-5a5f-416a-9cff-f7abc4238c6c tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a7a5a9773d84145bbf611439d025dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6983c51eda664586ba62e206acfcc2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:47:36.428749 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-7e83e731-5a5f-416a-9cff-f7abc4238c6c tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] 10.222.0.42 "GET /compute/v2.1/servers/544fc9bb-04f0-453c-a7bb-962f01ed2dd8" status: 200 len: 1267 microversion: 2.1 time: 0.158961 Jun 06 10:47:36.429371 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 473/928] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:47:36 2022] GET /compute/v2.1/servers/544fc9bb-04f0-453c-a7bb-962f01ed2dd8 => generated 1267 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:47:37.446683 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-b40cb991-ecf6-47dc-8dca-be360495de0c tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:47:37.447275 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-b40cb991-ecf6-47dc-8dca-be360495de0c tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] [instance: 544fc9bb-04f0-453c-a7bb-962f01ed2dd8] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:47:37.453686 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-b40cb991-ecf6-47dc-8dca-be360495de0c tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:47:37.454123 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-b40cb991-ecf6-47dc-8dca-be360495de0c tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:47:37.454909 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-b40cb991-ecf6-47dc-8dca-be360495de0c tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:47:37.455334 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-b40cb991-ecf6-47dc-8dca-be360495de0c tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:47:37.590027 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-b40cb991-ecf6-47dc-8dca-be360495de0c tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a7a5a9773d84145bbf611439d025dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6983c51eda664586ba62e206acfcc2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:47:37.597338 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-b40cb991-ecf6-47dc-8dca-be360495de0c tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] 10.222.0.42 "GET /compute/v2.1/servers/544fc9bb-04f0-453c-a7bb-962f01ed2dd8" status: 200 len: 1267 microversion: 2.1 time: 0.154570 Jun 06 10:47:37.597889 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 456/929] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:47:37 2022] GET /compute/v2.1/servers/544fc9bb-04f0-453c-a7bb-962f01ed2dd8 => generated 1267 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:47:38.614536 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-9835c17a-ac28-4de2-97fd-54a6a7a341b6 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:47:38.615081 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-9835c17a-ac28-4de2-97fd-54a6a7a341b6 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] [instance: 544fc9bb-04f0-453c-a7bb-962f01ed2dd8] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:47:38.621713 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-9835c17a-ac28-4de2-97fd-54a6a7a341b6 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:47:38.622159 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-9835c17a-ac28-4de2-97fd-54a6a7a341b6 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:47:38.622919 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-9835c17a-ac28-4de2-97fd-54a6a7a341b6 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:47:38.623352 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-9835c17a-ac28-4de2-97fd-54a6a7a341b6 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:47:38.761463 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-9835c17a-ac28-4de2-97fd-54a6a7a341b6 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a7a5a9773d84145bbf611439d025dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6983c51eda664586ba62e206acfcc2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:47:38.770132 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-9835c17a-ac28-4de2-97fd-54a6a7a341b6 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] 10.222.0.42 "GET /compute/v2.1/servers/544fc9bb-04f0-453c-a7bb-962f01ed2dd8" status: 200 len: 1267 microversion: 2.1 time: 0.160180 Jun 06 10:47:38.770717 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 474/930] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:47:38 2022] GET /compute/v2.1/servers/544fc9bb-04f0-453c-a7bb-962f01ed2dd8 => generated 1267 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:47:38.917637 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [req-79a6cd62-d89a-4c3b-971c-7d53fddd1037 req-6b379338-9c09-4642-9f46-759d4d253603 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "544fc9bb-04f0-453c-a7bb-962f01ed2dd8", "name": "network-vif-plugged", "status": "completed", "tag": "8abb5193-66bd-4d14-8ab2-9e216f171f63"}]} {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 10:47:38.927697 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [req-79a6cd62-d89a-4c3b-971c-7d53fddd1037 req-6b379338-9c09-4642-9f46-759d4d253603 service nova] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:47:38.928366 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [req-79a6cd62-d89a-4c3b-971c-7d53fddd1037 req-6b379338-9c09-4642-9f46-759d4d253603 service nova] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:47:38.939563 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.compute.server_external_events [req-79a6cd62-d89a-4c3b-971c-7d53fddd1037 req-6b379338-9c09-4642-9f46-759d4d253603 service nova] Creating event network-vif-plugged:8abb5193-66bd-4d14-8ab2-9e216f171f63 for instance 544fc9bb-04f0-453c-a7bb-962f01ed2dd8 on hv-cinder-84482 Jun 06 10:47:38.944827 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [req-79a6cd62-d89a-4c3b-971c-7d53fddd1037 req-6b379338-9c09-4642-9f46-759d4d253603 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030867 Jun 06 10:47:38.945416 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 457/931] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Jun 6 10:47:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 10:47:39.787995 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-b8e1df73-613d-46be-8516-d4f7b7bb2ee6 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:47:39.788604 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-b8e1df73-613d-46be-8516-d4f7b7bb2ee6 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] [instance: 544fc9bb-04f0-453c-a7bb-962f01ed2dd8] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:47:39.794987 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-b8e1df73-613d-46be-8516-d4f7b7bb2ee6 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:47:39.795430 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-b8e1df73-613d-46be-8516-d4f7b7bb2ee6 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:47:39.796305 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-b8e1df73-613d-46be-8516-d4f7b7bb2ee6 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:47:39.796732 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-b8e1df73-613d-46be-8516-d4f7b7bb2ee6 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:47:39.929145 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-b8e1df73-613d-46be-8516-d4f7b7bb2ee6 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a7a5a9773d84145bbf611439d025dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6983c51eda664586ba62e206acfcc2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:47:39.936462 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-b8e1df73-613d-46be-8516-d4f7b7bb2ee6 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] 10.222.0.42 "GET /compute/v2.1/servers/544fc9bb-04f0-453c-a7bb-962f01ed2dd8" status: 200 len: 1267 microversion: 2.1 time: 0.153404 Jun 06 10:47:39.937122 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 475/932] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:47:39 2022] GET /compute/v2.1/servers/544fc9bb-04f0-453c-a7bb-962f01ed2dd8 => generated 1267 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:47:40.953903 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-415b9695-145e-4f23-bd08-de7762cdbd62 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:47:40.954606 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-415b9695-145e-4f23-bd08-de7762cdbd62 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] [instance: 544fc9bb-04f0-453c-a7bb-962f01ed2dd8] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:47:40.961448 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-415b9695-145e-4f23-bd08-de7762cdbd62 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:47:40.961895 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-415b9695-145e-4f23-bd08-de7762cdbd62 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:47:40.962653 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-415b9695-145e-4f23-bd08-de7762cdbd62 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:47:40.963086 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-415b9695-145e-4f23-bd08-de7762cdbd62 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:47:41.093631 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-415b9695-145e-4f23-bd08-de7762cdbd62 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a7a5a9773d84145bbf611439d025dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6983c51eda664586ba62e206acfcc2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:47:41.101138 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-415b9695-145e-4f23-bd08-de7762cdbd62 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] 10.222.0.42 "GET /compute/v2.1/servers/544fc9bb-04f0-453c-a7bb-962f01ed2dd8" status: 200 len: 1453 microversion: 2.1 time: 0.151410 Jun 06 10:47:41.101699 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 458/933] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:47:40 2022] GET /compute/v2.1/servers/544fc9bb-04f0-453c-a7bb-962f01ed2dd8 => generated 1453 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:47:41.117600 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-865ce1cd-bbfa-4611-b2ce-6e895e938efc tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:47:41.118211 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-865ce1cd-bbfa-4611-b2ce-6e895e938efc tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] [instance: 544fc9bb-04f0-453c-a7bb-962f01ed2dd8] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:47:41.124647 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-865ce1cd-bbfa-4611-b2ce-6e895e938efc tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:47:41.125084 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-865ce1cd-bbfa-4611-b2ce-6e895e938efc tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:47:41.126160 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-865ce1cd-bbfa-4611-b2ce-6e895e938efc tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:47:41.126594 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-865ce1cd-bbfa-4611-b2ce-6e895e938efc tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:47:41.254749 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-865ce1cd-bbfa-4611-b2ce-6e895e938efc tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a7a5a9773d84145bbf611439d025dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6983c51eda664586ba62e206acfcc2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:47:41.262135 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-865ce1cd-bbfa-4611-b2ce-6e895e938efc tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] 10.222.0.42 "GET /compute/v2.1/servers/544fc9bb-04f0-453c-a7bb-962f01ed2dd8" status: 200 len: 1453 microversion: 2.1 time: 0.148418 Jun 06 10:47:41.262697 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 476/934] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:47:41 2022] GET /compute/v2.1/servers/544fc9bb-04f0-453c-a7bb-962f01ed2dd8 => generated 1453 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:47:43.183177 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [req-b89f06b0-c8f8-41e7-9ac0-b5910b59dade req-e81af3e1-9eca-4b6a-b1a5-8bc4921ac241 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "544fc9bb-04f0-453c-a7bb-962f01ed2dd8", "tag": "8abb5193-66bd-4d14-8ab2-9e216f171f63"}]} {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 10:47:43.192605 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [req-b89f06b0-c8f8-41e7-9ac0-b5910b59dade req-e81af3e1-9eca-4b6a-b1a5-8bc4921ac241 service nova] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:47:43.193129 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [req-b89f06b0-c8f8-41e7-9ac0-b5910b59dade req-e81af3e1-9eca-4b6a-b1a5-8bc4921ac241 service nova] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:47:43.203950 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.compute.server_external_events [req-b89f06b0-c8f8-41e7-9ac0-b5910b59dade req-e81af3e1-9eca-4b6a-b1a5-8bc4921ac241 service nova] Creating event network-changed:8abb5193-66bd-4d14-8ab2-9e216f171f63 for instance 544fc9bb-04f0-453c-a7bb-962f01ed2dd8 on hv-cinder-84482 Jun 06 10:47:43.209788 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [req-b89f06b0-c8f8-41e7-9ac0-b5910b59dade req-e81af3e1-9eca-4b6a-b1a5-8bc4921ac241 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030358 Jun 06 10:47:43.210476 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 459/935] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Jun 6 10:47:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 10:47:50.122007 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-bf545577-43c4-4f3d-9e73-c83ad96a0597 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:47:50.122587 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-bf545577-43c4-4f3d-9e73-c83ad96a0597 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] [instance: 8341de11-491a-48f9-a3ff-2871ec19d297] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:47:50.129287 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-bf545577-43c4-4f3d-9e73-c83ad96a0597 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:47:50.129762 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-bf545577-43c4-4f3d-9e73-c83ad96a0597 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:47:50.130537 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-bf545577-43c4-4f3d-9e73-c83ad96a0597 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:47:50.130968 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-bf545577-43c4-4f3d-9e73-c83ad96a0597 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:47:50.158160 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-bf545577-43c4-4f3d-9e73-c83ad96a0597 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] 10.222.0.42 "GET /compute/v2.1/servers/8341de11-491a-48f9-a3ff-2871ec19d297/ips" status: 200 len: 149 microversion: 2.1 time: 0.039979 Jun 06 10:47:50.159363 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 477/936] 10.222.0.42 () {58 vars in 1247 bytes} [Mon Jun 6 10:47:50 2022] GET /compute/v2.1/servers/8341de11-491a-48f9-a3ff-2871ec19d297/ips => generated 149 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 06 10:47:51.494964 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-603754ee-2978-49bb-a96e-5b1eecbbbcc9 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9af4ca42-ecce-48a8-8854-a623ac76a53e"}} {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 10:47:51.496122 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-603754ee-2978-49bb-a96e-5b1eecbbbcc9 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] [instance: 8341de11-491a-48f9-a3ff-2871ec19d297] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:47:51.502272 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-603754ee-2978-49bb-a96e-5b1eecbbbcc9 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:47:51.503258 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-603754ee-2978-49bb-a96e-5b1eecbbbcc9 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:47:51.504047 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-603754ee-2978-49bb-a96e-5b1eecbbbcc9 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:47:51.504479 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-603754ee-2978-49bb-a96e-5b1eecbbbcc9 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:47:51.730459 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-603754ee-2978-49bb-a96e-5b1eecbbbcc9 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] 10.222.0.42 "POST /compute/v2.1/servers/8341de11-491a-48f9-a3ff-2871ec19d297/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.240317 Jun 06 10:47:51.731128 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 460/937] 10.222.0.42 () {60 vars in 1322 bytes} [Mon Jun 6 10:47:51 2022] POST /compute/v2.1/servers/8341de11-491a-48f9-a3ff-2871ec19d297/os-volume_attachments => generated 194 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 10:47:58.233240 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-d3b575de-3bb5-4aec-a184-06ff47d2ef50 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:47:58.233743 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-d3b575de-3bb5-4aec-a184-06ff47d2ef50 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] [instance: 8341de11-491a-48f9-a3ff-2871ec19d297] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:47:58.241262 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-d3b575de-3bb5-4aec-a184-06ff47d2ef50 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:47:58.241708 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-d3b575de-3bb5-4aec-a184-06ff47d2ef50 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:47:58.242466 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-d3b575de-3bb5-4aec-a184-06ff47d2ef50 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:47:58.242897 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-d3b575de-3bb5-4aec-a184-06ff47d2ef50 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:47:58.319603 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.objects.instance [None req-d3b575de-3bb5-4aec-a184-06ff47d2ef50 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lazy-loading 'services' on Instance uuid 8341de11-491a-48f9-a3ff-2871ec19d297 {{(pid=129349) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 06 10:47:58.391945 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-d3b575de-3bb5-4aec-a184-06ff47d2ef50 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] 10.222.0.42 "DELETE /compute/v2.1/servers/8341de11-491a-48f9-a3ff-2871ec19d297/os-volume_attachments/9af4ca42-ecce-48a8-8854-a623ac76a53e" status: 202 len: 0 microversion: 2.1 time: 0.162389 Jun 06 10:47:58.392537 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 478/938] 10.222.0.42 () {58 vars in 1415 bytes} [Mon Jun 6 10:47:58 2022] DELETE /compute/v2.1/servers/8341de11-491a-48f9-a3ff-2871ec19d297/os-volume_attachments/9af4ca42-ecce-48a8-8854-a623ac76a53e => generated 0 bytes in 164 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 06 10:47:58.401870 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-51f46394-fbb7-4e79-8c5a-18bf36795499 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:47:58.402876 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-51f46394-fbb7-4e79-8c5a-18bf36795499 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] [instance: 8341de11-491a-48f9-a3ff-2871ec19d297] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:47:58.409234 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-51f46394-fbb7-4e79-8c5a-18bf36795499 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:47:58.409769 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-51f46394-fbb7-4e79-8c5a-18bf36795499 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:47:58.410560 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-51f46394-fbb7-4e79-8c5a-18bf36795499 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:47:58.414596 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-51f46394-fbb7-4e79-8c5a-18bf36795499 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:47:58.418354 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG dbcounter [-] [129350] Writing DB stats nova_cell1:SELECT=57,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 10:47:58.456708 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-51f46394-fbb7-4e79-8c5a-18bf36795499 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] 10.222.0.42 "GET /compute/v2.1/servers/8341de11-491a-48f9-a3ff-2871ec19d297/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059597 Jun 06 10:47:58.457274 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 461/939] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jun 6 10:47:58 2022] GET /compute/v2.1/servers/8341de11-491a-48f9-a3ff-2871ec19d297/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 10:47:59.469524 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-8060c9ba-d8db-49b8-9fc4-06d1ade08a37 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:47:59.470549 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-8060c9ba-d8db-49b8-9fc4-06d1ade08a37 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] [instance: 8341de11-491a-48f9-a3ff-2871ec19d297] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:47:59.478014 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-8060c9ba-d8db-49b8-9fc4-06d1ade08a37 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:47:59.478462 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-8060c9ba-d8db-49b8-9fc4-06d1ade08a37 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:47:59.479239 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-8060c9ba-d8db-49b8-9fc4-06d1ade08a37 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:47:59.479662 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-8060c9ba-d8db-49b8-9fc4-06d1ade08a37 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:47:59.483446 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG dbcounter [-] [129349] Writing DB stats nova_cell1:SELECT=57,nova_cell1:INSERT=1 {{(pid=129349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 10:47:59.510937 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-8060c9ba-d8db-49b8-9fc4-06d1ade08a37 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] 10.222.0.42 "GET /compute/v2.1/servers/8341de11-491a-48f9-a3ff-2871ec19d297/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046165 Jun 06 10:47:59.511490 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 479/940] 10.222.0.42 () {58 vars in 1301 bytes} [Mon Jun 6 10:47:59 2022] GET /compute/v2.1/servers/8341de11-491a-48f9-a3ff-2871ec19d297/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 06 10:47:59.578539 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-48114d18-b27f-4596-923d-72ff7670aef5 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:47:59.579058 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-48114d18-b27f-4596-923d-72ff7670aef5 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] [instance: 8341de11-491a-48f9-a3ff-2871ec19d297] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:47:59.585662 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-48114d18-b27f-4596-923d-72ff7670aef5 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:47:59.586111 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-48114d18-b27f-4596-923d-72ff7670aef5 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:47:59.586880 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-48114d18-b27f-4596-923d-72ff7670aef5 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:47:59.587319 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-48114d18-b27f-4596-923d-72ff7670aef5 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:47:59.612692 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-48114d18-b27f-4596-923d-72ff7670aef5 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] [instance: 8341de11-491a-48f9-a3ff-2871ec19d297] Going to try to terminate instance {{(pid=129350) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 06 10:47:59.686563 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-48114d18-b27f-4596-923d-72ff7670aef5 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] 10.222.0.42 "DELETE /compute/v2.1/servers/8341de11-491a-48f9-a3ff-2871ec19d297" status: 204 len: 0 microversion: 2.1 time: 0.111560 Jun 06 10:47:59.687244 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 462/941] 10.222.0.42 () {58 vars in 1238 bytes} [Mon Jun 6 10:47:59 2022] DELETE /compute/v2.1/servers/8341de11-491a-48f9-a3ff-2871ec19d297 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 06 10:47:59.696437 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-f4d913fb-b8f6-4a82-adcf-30b2c35674ff tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:47:59.697048 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-f4d913fb-b8f6-4a82-adcf-30b2c35674ff tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] [instance: 8341de11-491a-48f9-a3ff-2871ec19d297] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:47:59.702907 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-f4d913fb-b8f6-4a82-adcf-30b2c35674ff tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:47:59.703347 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-f4d913fb-b8f6-4a82-adcf-30b2c35674ff tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:47:59.704124 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-f4d913fb-b8f6-4a82-adcf-30b2c35674ff tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:47:59.704557 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-f4d913fb-b8f6-4a82-adcf-30b2c35674ff tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:47:59.837130 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-f4d913fb-b8f6-4a82-adcf-30b2c35674ff tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ba341ea1ac34874bbfb8b2f713aea1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92244b4ae17d49bebe621e803bd9ae58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:47:59.844603 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-f4d913fb-b8f6-4a82-adcf-30b2c35674ff tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] 10.222.0.42 "GET /compute/v2.1/servers/8341de11-491a-48f9-a3ff-2871ec19d297" status: 200 len: 1681 microversion: 2.1 time: 0.152025 Jun 06 10:47:59.845155 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 480/942] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:47:59 2022] GET /compute/v2.1/servers/8341de11-491a-48f9-a3ff-2871ec19d297 => generated 1681 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:48:00.863691 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-f4c6083e-3ff6-4baa-800c-4f77af03236b tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:48:00.864412 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-f4c6083e-3ff6-4baa-800c-4f77af03236b tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] [instance: 8341de11-491a-48f9-a3ff-2871ec19d297] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:48:00.870852 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-f4c6083e-3ff6-4baa-800c-4f77af03236b tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:48:00.871298 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-f4c6083e-3ff6-4baa-800c-4f77af03236b tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:48:00.872121 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-f4c6083e-3ff6-4baa-800c-4f77af03236b tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:48:00.872552 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-f4c6083e-3ff6-4baa-800c-4f77af03236b tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:48:01.005464 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-f4c6083e-3ff6-4baa-800c-4f77af03236b tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ba341ea1ac34874bbfb8b2f713aea1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92244b4ae17d49bebe621e803bd9ae58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:48:01.012827 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-f4c6083e-3ff6-4baa-800c-4f77af03236b tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] 10.222.0.42 "GET /compute/v2.1/servers/8341de11-491a-48f9-a3ff-2871ec19d297" status: 200 len: 1681 microversion: 2.1 time: 0.153437 Jun 06 10:48:01.013381 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 463/943] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:48:00 2022] GET /compute/v2.1/servers/8341de11-491a-48f9-a3ff-2871ec19d297 => generated 1681 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:48:02.032066 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-d3468a76-63a1-4a12-bbd8-4f0d043de16b tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:48:02.032686 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-d3468a76-63a1-4a12-bbd8-4f0d043de16b tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] [instance: 8341de11-491a-48f9-a3ff-2871ec19d297] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:48:02.040367 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-d3468a76-63a1-4a12-bbd8-4f0d043de16b tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:48:02.040817 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-d3468a76-63a1-4a12-bbd8-4f0d043de16b tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:48:02.041926 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-d3468a76-63a1-4a12-bbd8-4f0d043de16b tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:48:02.042225 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-d3468a76-63a1-4a12-bbd8-4f0d043de16b tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:48:02.057383 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [req-5034439e-9d1c-46d3-bada-ca9a1b78dde6 req-61c35950-ac74-4cc3-a0af-efcd9e1aaf27 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8341de11-491a-48f9-a3ff-2871ec19d297", "name": "network-vif-deleted", "tag": "319cb990-8084-43f8-b630-21d54163fe9b"}]} {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 10:48:02.066422 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [req-5034439e-9d1c-46d3-bada-ca9a1b78dde6 req-61c35950-ac74-4cc3-a0af-efcd9e1aaf27 service nova] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:48:02.066862 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [req-5034439e-9d1c-46d3-bada-ca9a1b78dde6 req-61c35950-ac74-4cc3-a0af-efcd9e1aaf27 service nova] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:48:02.078486 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.compute.server_external_events [req-5034439e-9d1c-46d3-bada-ca9a1b78dde6 req-61c35950-ac74-4cc3-a0af-efcd9e1aaf27 service nova] Creating event network-vif-deleted:319cb990-8084-43f8-b630-21d54163fe9b for instance 8341de11-491a-48f9-a3ff-2871ec19d297 on hv-cinder-84482 Jun 06 10:48:02.084196 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [req-5034439e-9d1c-46d3-bada-ca9a1b78dde6 req-61c35950-ac74-4cc3-a0af-efcd9e1aaf27 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030292 Jun 06 10:48:02.088639 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 464/944] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Jun 6 10:48:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 06 10:48:02.112257 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-d3468a76-63a1-4a12-bbd8-4f0d043de16b tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ba341ea1ac34874bbfb8b2f713aea1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92244b4ae17d49bebe621e803bd9ae58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:48:02.121732 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-d3468a76-63a1-4a12-bbd8-4f0d043de16b tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] 10.222.0.42 "GET /compute/v2.1/servers/8341de11-491a-48f9-a3ff-2871ec19d297" status: 200 len: 1613 microversion: 2.1 time: 0.093508 Jun 06 10:48:02.122623 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 481/945] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:48:02 2022] GET /compute/v2.1/servers/8341de11-491a-48f9-a3ff-2871ec19d297 => generated 1613 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:48:03.139668 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-0086f2c2-9f39-47d2-beb7-5be8cae421d2 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:48:03.140402 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-0086f2c2-9f39-47d2-beb7-5be8cae421d2 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] [instance: 8341de11-491a-48f9-a3ff-2871ec19d297] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:48:03.146997 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-0086f2c2-9f39-47d2-beb7-5be8cae421d2 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:48:03.147444 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-0086f2c2-9f39-47d2-beb7-5be8cae421d2 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:48:03.148221 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-0086f2c2-9f39-47d2-beb7-5be8cae421d2 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:48:03.148650 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-0086f2c2-9f39-47d2-beb7-5be8cae421d2 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:48:03.162437 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.wsgi [None req-0086f2c2-9f39-47d2-beb7-5be8cae421d2 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] HTTP exception thrown: Instance 8341de11-491a-48f9-a3ff-2871ec19d297 could not be found. Jun 06 10:48:03.164059 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-0086f2c2-9f39-47d2-beb7-5be8cae421d2 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Request method failure captured: Jun 06 10:48:03.164059 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: request: GET /compute/v2.1/servers/8341de11-491a-48f9-a3ff-2871ec19d297 HTTP/1.1 Jun 06 10:48:03.164059 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: Accept: application/json Jun 06 10:48:03.164059 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: Accept-Encoding: identity Jun 06 10:48:03.164059 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: Connection: close Jun 06 10:48:03.164059 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: Content-Length: 0 Jun 06 10:48:03.164059 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: Content-Type: application/json Jun 06 10:48:03.164059 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: Host: 10.222.0.42 Jun 06 10:48:03.164059 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: Openstack-System-Scope: None Jun 06 10:48:03.164059 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: User-Agent: python-urllib3/1.26.9 Jun 06 10:48:03.164059 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Auth-Token: gAAAAABindpS5StX_xHu79Eyze6WiReBQv-1XmH_nbXfOmEXKeceOSLZM5qrKAT8lmCw6P5JEWqX6Nq9MOy22mDxxwSXFHT-nuQ59QQYMYHodXP_RU6pUiqpnXRk4PCXE--rTT-t8YJ-1daoywKB7L9jlYu_naOtOmjpMkLKZOiBTDyqPdUS4xY Jun 06 10:48:03.164059 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Domain-Id: None Jun 06 10:48:03.164059 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Domain-Name: None Jun 06 10:48:03.164059 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Identity-Status: Confirmed Jun 06 10:48:03.164059 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Is-Admin-Project: True Jun 06 10:48:03.164059 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Project-Domain-Id: default Jun 06 10:48:03.164059 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Project-Domain-Name: Default Jun 06 10:48:03.164059 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Project-Id: 92244b4ae17d49bebe621e803bd9ae58 Jun 06 10:48:03.164059 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Project-Name: tempest-AttachVolumeNegativeTest-363942965 Jun 06 10:48:03.164059 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Role: member,reader Jun 06 10:48:03.164059 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Roles: member,reader Jun 06 10:48:03.165605 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/92244b4ae17d49bebe621e803bd9ae58"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/92244b4ae17d49bebe621e803bd9ae58"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/92244b4ae17d49bebe621e803bd9ae58"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_92244b4ae17d49bebe621e803bd9ae58", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Jun 06 10:48:03.165605 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Tenant: tempest-AttachVolumeNegativeTest-363942965 Jun 06 10:48:03.165605 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Tenant-Id: 92244b4ae17d49bebe621e803bd9ae58 Jun 06 10:48:03.165605 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-363942965 Jun 06 10:48:03.165605 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-User: tempest-AttachVolumeNegativeTest-363942965-project Jun 06 10:48:03.165605 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-User-Domain-Id: default Jun 06 10:48:03.165605 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-User-Domain-Name: Default Jun 06 10:48:03.165605 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-User-Id: 7ba341ea1ac34874bbfb8b2f713aea1b Jun 06 10:48:03.165605 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-User-Name: tempest-AttachVolumeNegativeTest-363942965-project Jun 06 10:48:03.165605 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: method: > Jun 06 10:48:03.165605 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: exception: Instance 8341de11-491a-48f9-a3ff-2871ec19d297 could not be found. Jun 06 10:48:03.165605 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: action_args: {'id': '8341de11-491a-48f9-a3ff-2871ec19d297'} Jun 06 10:48:03.166445 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 10:48:03.166445 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 10:48:03.166445 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 06 10:48:03.166445 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 06 10:48:03.166445 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 06 10:48:03.166445 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 06 10:48:03.166445 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 06 10:48:03.166445 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 06 10:48:03.166445 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 06 10:48:03.166445 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 06 10:48:03.166445 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8341de11-491a-48f9-a3ff-2871ec19d297 could not be found. Jun 06 10:48:03.166445 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi Jun 06 10:48:03.166445 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 10:48:03.166445 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi Jun 06 10:48:03.166445 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 10:48:03.166445 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 10:48:03.166445 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 10:48:03.166445 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 10:48:03.166445 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 10:48:03.166445 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 10:48:03.168109 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 10:48:03.168109 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 06 10:48:03.168109 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 06 10:48:03.168109 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 06 10:48:03.168109 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 06 10:48:03.168109 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 06 10:48:03.168109 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 06 10:48:03.168109 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8341de11-491a-48f9-a3ff-2871ec19d297 could not be found. Jun 06 10:48:03.168109 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi Jun 06 10:48:03.168109 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 10:48:03.168109 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi Jun 06 10:48:03.168109 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 10:48:03.168109 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 10:48:03.168109 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 10:48:03.168109 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 10:48:03.168109 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 10:48:03.168109 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8341de11-491a-48f9-a3ff-2871ec19d297 could not be found. Jun 06 10:48:03.168109 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi Jun 06 10:48:03.169506 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-0086f2c2-9f39-47d2-beb7-5be8cae421d2 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Returning 404 to user: Instance 8341de11-491a-48f9-a3ff-2871ec19d297 could not be found. {{(pid=129350) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 10:48:03.169506 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-0086f2c2-9f39-47d2-beb7-5be8cae421d2 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] 10.222.0.42 "GET /compute/v2.1/servers/8341de11-491a-48f9-a3ff-2871ec19d297" status: 404 len: 111 microversion: 2.1 time: 0.030691 Jun 06 10:48:03.169506 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 465/946] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:48:03 2022] GET /compute/v2.1/servers/8341de11-491a-48f9-a3ff-2871ec19d297 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 06 10:48:03.174272 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-5a50d1cb-061f-4424-adde-a0f70b5bcc19 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Calling method '.version_select at 0x7f8fd82b9280>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:48:03.204729 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-5a50d1cb-061f-4424-adde-a0f70b5bcc19 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-891369921" status: 202 len: 0 microversion: 2.1 time: 0.034218 Jun 06 10:48:03.205297 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 482/947] 10.222.0.42 () {58 vars in 1217 bytes} [Mon Jun 6 10:48:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-891369921 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 06 10:48:04.934812 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-33170c5d-67b6-45ca-bc39-95d45402ec6a tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:48:04.935317 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-33170c5d-67b6-45ca-bc39-95d45402ec6a tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] [instance: 8341de11-491a-48f9-a3ff-2871ec19d297] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:48:04.942616 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-33170c5d-67b6-45ca-bc39-95d45402ec6a tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:48:04.943007 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-33170c5d-67b6-45ca-bc39-95d45402ec6a tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:48:04.943761 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-33170c5d-67b6-45ca-bc39-95d45402ec6a tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:48:04.944216 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-33170c5d-67b6-45ca-bc39-95d45402ec6a tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:48:04.957256 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.wsgi [None req-33170c5d-67b6-45ca-bc39-95d45402ec6a tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] HTTP exception thrown: Instance 8341de11-491a-48f9-a3ff-2871ec19d297 could not be found. Jun 06 10:48:04.958769 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-33170c5d-67b6-45ca-bc39-95d45402ec6a tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Request method failure captured: Jun 06 10:48:04.958769 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: request: DELETE /compute/v2.1/servers/8341de11-491a-48f9-a3ff-2871ec19d297 HTTP/1.1 Jun 06 10:48:04.958769 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: Accept: application/json Jun 06 10:48:04.958769 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: Accept-Encoding: identity Jun 06 10:48:04.958769 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: Connection: close Jun 06 10:48:04.958769 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: Content-Length: 0 Jun 06 10:48:04.958769 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: Content-Type: application/json Jun 06 10:48:04.958769 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: Host: 10.222.0.42 Jun 06 10:48:04.958769 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: Openstack-System-Scope: None Jun 06 10:48:04.958769 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: User-Agent: python-urllib3/1.26.9 Jun 06 10:48:04.958769 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Auth-Token: gAAAAABindpS5StX_xHu79Eyze6WiReBQv-1XmH_nbXfOmEXKeceOSLZM5qrKAT8lmCw6P5JEWqX6Nq9MOy22mDxxwSXFHT-nuQ59QQYMYHodXP_RU6pUiqpnXRk4PCXE--rTT-t8YJ-1daoywKB7L9jlYu_naOtOmjpMkLKZOiBTDyqPdUS4xY Jun 06 10:48:04.958769 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Domain-Id: None Jun 06 10:48:04.958769 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Domain-Name: None Jun 06 10:48:04.958769 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Identity-Status: Confirmed Jun 06 10:48:04.958769 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Is-Admin-Project: True Jun 06 10:48:04.958769 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Project-Domain-Id: default Jun 06 10:48:04.958769 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Project-Domain-Name: Default Jun 06 10:48:04.958769 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Project-Id: 92244b4ae17d49bebe621e803bd9ae58 Jun 06 10:48:04.958769 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Project-Name: tempest-AttachVolumeNegativeTest-363942965 Jun 06 10:48:04.958769 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Role: member,reader Jun 06 10:48:04.958769 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Roles: member,reader Jun 06 10:48:04.960425 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/92244b4ae17d49bebe621e803bd9ae58"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/92244b4ae17d49bebe621e803bd9ae58"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/92244b4ae17d49bebe621e803bd9ae58"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_92244b4ae17d49bebe621e803bd9ae58", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Jun 06 10:48:04.960425 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Tenant: tempest-AttachVolumeNegativeTest-363942965 Jun 06 10:48:04.960425 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Tenant-Id: 92244b4ae17d49bebe621e803bd9ae58 Jun 06 10:48:04.960425 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-363942965 Jun 06 10:48:04.960425 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-User: tempest-AttachVolumeNegativeTest-363942965-project Jun 06 10:48:04.960425 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-User-Domain-Id: default Jun 06 10:48:04.960425 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-User-Domain-Name: Default Jun 06 10:48:04.960425 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-User-Id: 7ba341ea1ac34874bbfb8b2f713aea1b Jun 06 10:48:04.960425 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-User-Name: tempest-AttachVolumeNegativeTest-363942965-project Jun 06 10:48:04.960425 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: method: > Jun 06 10:48:04.960425 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: exception: Instance 8341de11-491a-48f9-a3ff-2871ec19d297 could not be found. Jun 06 10:48:04.960425 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: action_args: {'id': '8341de11-491a-48f9-a3ff-2871ec19d297'} Jun 06 10:48:04.961308 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 10:48:04.961308 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 10:48:04.961308 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 06 10:48:04.961308 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 06 10:48:04.961308 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 06 10:48:04.961308 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 06 10:48:04.961308 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 06 10:48:04.961308 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 06 10:48:04.961308 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 06 10:48:04.961308 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 06 10:48:04.961308 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8341de11-491a-48f9-a3ff-2871ec19d297 could not be found. Jun 06 10:48:04.961308 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi Jun 06 10:48:04.961308 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 10:48:04.961308 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi Jun 06 10:48:04.961308 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 10:48:04.961308 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 10:48:04.961308 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 10:48:04.961308 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 10:48:04.961308 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 10:48:04.961308 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 10:48:04.962872 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 10:48:04.962872 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 06 10:48:04.962872 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 06 10:48:04.962872 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 06 10:48:04.962872 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 06 10:48:04.962872 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 06 10:48:04.962872 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 06 10:48:04.962872 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 06 10:48:04.962872 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 06 10:48:04.962872 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8341de11-491a-48f9-a3ff-2871ec19d297 could not be found. Jun 06 10:48:04.962872 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi Jun 06 10:48:04.962872 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 10:48:04.962872 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi Jun 06 10:48:04.962872 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 10:48:04.962872 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 10:48:04.962872 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 10:48:04.962872 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 10:48:04.962872 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 10:48:04.962872 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8341de11-491a-48f9-a3ff-2871ec19d297 could not be found. Jun 06 10:48:04.962872 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi Jun 06 10:48:04.964530 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-33170c5d-67b6-45ca-bc39-95d45402ec6a tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Returning 404 to user: Instance 8341de11-491a-48f9-a3ff-2871ec19d297 could not be found. {{(pid=129350) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 10:48:04.964530 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-33170c5d-67b6-45ca-bc39-95d45402ec6a tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] 10.222.0.42 "DELETE /compute/v2.1/servers/8341de11-491a-48f9-a3ff-2871ec19d297" status: 404 len: 111 microversion: 2.1 time: 0.029136 Jun 06 10:48:04.964530 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 466/948] 10.222.0.42 () {58 vars in 1238 bytes} [Mon Jun 6 10:48:04 2022] DELETE /compute/v2.1/servers/8341de11-491a-48f9-a3ff-2871ec19d297 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 06 10:48:04.969172 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-919c24fe-2de2-40a9-a444-3a9ca77f159c tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:48:04.969786 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-919c24fe-2de2-40a9-a444-3a9ca77f159c tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] [instance: 8341de11-491a-48f9-a3ff-2871ec19d297] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:48:04.976377 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-919c24fe-2de2-40a9-a444-3a9ca77f159c tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:48:04.976820 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-919c24fe-2de2-40a9-a444-3a9ca77f159c tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:48:04.977582 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-919c24fe-2de2-40a9-a444-3a9ca77f159c tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:48:04.978014 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-919c24fe-2de2-40a9-a444-3a9ca77f159c tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:48:04.991452 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.wsgi [None req-919c24fe-2de2-40a9-a444-3a9ca77f159c tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] HTTP exception thrown: Instance 8341de11-491a-48f9-a3ff-2871ec19d297 could not be found. Jun 06 10:48:04.993113 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-919c24fe-2de2-40a9-a444-3a9ca77f159c tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Request method failure captured: Jun 06 10:48:04.993113 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: request: GET /compute/v2.1/servers/8341de11-491a-48f9-a3ff-2871ec19d297 HTTP/1.1 Jun 06 10:48:04.993113 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: Accept: application/json Jun 06 10:48:04.993113 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: Accept-Encoding: identity Jun 06 10:48:04.993113 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: Connection: close Jun 06 10:48:04.993113 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: Content-Length: 0 Jun 06 10:48:04.993113 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: Content-Type: application/json Jun 06 10:48:04.993113 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: Host: 10.222.0.42 Jun 06 10:48:04.993113 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: Openstack-System-Scope: None Jun 06 10:48:04.993113 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: User-Agent: python-urllib3/1.26.9 Jun 06 10:48:04.993113 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Auth-Token: gAAAAABindpS5StX_xHu79Eyze6WiReBQv-1XmH_nbXfOmEXKeceOSLZM5qrKAT8lmCw6P5JEWqX6Nq9MOy22mDxxwSXFHT-nuQ59QQYMYHodXP_RU6pUiqpnXRk4PCXE--rTT-t8YJ-1daoywKB7L9jlYu_naOtOmjpMkLKZOiBTDyqPdUS4xY Jun 06 10:48:04.993113 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Domain-Id: None Jun 06 10:48:04.993113 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Domain-Name: None Jun 06 10:48:04.993113 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Identity-Status: Confirmed Jun 06 10:48:04.993113 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Is-Admin-Project: True Jun 06 10:48:04.993113 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Project-Domain-Id: default Jun 06 10:48:04.993113 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Project-Domain-Name: Default Jun 06 10:48:04.993113 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Project-Id: 92244b4ae17d49bebe621e803bd9ae58 Jun 06 10:48:04.993113 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Project-Name: tempest-AttachVolumeNegativeTest-363942965 Jun 06 10:48:04.993113 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Role: member,reader Jun 06 10:48:04.993113 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Roles: member,reader Jun 06 10:48:04.994742 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/92244b4ae17d49bebe621e803bd9ae58"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/92244b4ae17d49bebe621e803bd9ae58"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/92244b4ae17d49bebe621e803bd9ae58"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_92244b4ae17d49bebe621e803bd9ae58", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Jun 06 10:48:04.994742 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Tenant: tempest-AttachVolumeNegativeTest-363942965 Jun 06 10:48:04.994742 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Tenant-Id: 92244b4ae17d49bebe621e803bd9ae58 Jun 06 10:48:04.994742 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-363942965 Jun 06 10:48:04.994742 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-User: tempest-AttachVolumeNegativeTest-363942965-project Jun 06 10:48:04.994742 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-User-Domain-Id: default Jun 06 10:48:04.994742 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-User-Domain-Name: Default Jun 06 10:48:04.994742 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-User-Id: 7ba341ea1ac34874bbfb8b2f713aea1b Jun 06 10:48:04.994742 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-User-Name: tempest-AttachVolumeNegativeTest-363942965-project Jun 06 10:48:04.994742 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: method: > Jun 06 10:48:04.994742 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: exception: Instance 8341de11-491a-48f9-a3ff-2871ec19d297 could not be found. Jun 06 10:48:04.994742 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: action_args: {'id': '8341de11-491a-48f9-a3ff-2871ec19d297'} Jun 06 10:48:04.995873 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 10:48:04.995873 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 10:48:04.995873 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 06 10:48:04.995873 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 06 10:48:04.995873 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 06 10:48:04.995873 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 06 10:48:04.995873 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 06 10:48:04.995873 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 06 10:48:04.995873 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 06 10:48:04.995873 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 06 10:48:04.995873 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8341de11-491a-48f9-a3ff-2871ec19d297 could not be found. Jun 06 10:48:04.995873 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Jun 06 10:48:04.995873 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 10:48:04.995873 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Jun 06 10:48:04.995873 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 10:48:04.995873 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 10:48:04.995873 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 10:48:04.995873 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 10:48:04.995873 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 10:48:04.995873 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 10:48:04.997360 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 10:48:04.997360 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 06 10:48:04.997360 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 06 10:48:04.997360 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 06 10:48:04.997360 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 06 10:48:04.997360 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 06 10:48:04.997360 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 06 10:48:04.997360 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8341de11-491a-48f9-a3ff-2871ec19d297 could not be found. Jun 06 10:48:04.997360 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Jun 06 10:48:04.997360 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 10:48:04.997360 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Jun 06 10:48:04.997360 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 10:48:04.997360 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 10:48:04.997360 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 10:48:04.997360 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 10:48:04.997360 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 10:48:04.997360 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8341de11-491a-48f9-a3ff-2871ec19d297 could not be found. Jun 06 10:48:04.997360 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Jun 06 10:48:04.998982 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-919c24fe-2de2-40a9-a444-3a9ca77f159c tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Returning 404 to user: Instance 8341de11-491a-48f9-a3ff-2871ec19d297 could not be found. {{(pid=129349) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 10:48:04.998982 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-919c24fe-2de2-40a9-a444-3a9ca77f159c tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] 10.222.0.42 "GET /compute/v2.1/servers/8341de11-491a-48f9-a3ff-2871ec19d297" status: 404 len: 111 microversion: 2.1 time: 0.029676 Jun 06 10:48:04.998982 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 483/949] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:48:04 2022] GET /compute/v2.1/servers/8341de11-491a-48f9-a3ff-2871ec19d297 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 06 10:48:06.126735 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-64a7af0d-f042-43f7-88dd-4c04856ce629 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:48:06.127262 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-64a7af0d-f042-43f7-88dd-4c04856ce629 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] [instance: 2e2eb841-906d-4ab2-b15e-63f07cf3037d] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:48:06.130375 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG dbcounter [-] [129350] Writing DB stats nova_api:SELECT=29,nova_api:UPDATE=1 {{(pid=129350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 10:48:06.136118 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-64a7af0d-f042-43f7-88dd-4c04856ce629 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:48:06.136565 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-64a7af0d-f042-43f7-88dd-4c04856ce629 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:48:06.137328 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-64a7af0d-f042-43f7-88dd-4c04856ce629 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:48:06.137763 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-64a7af0d-f042-43f7-88dd-4c04856ce629 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:48:06.152959 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.wsgi [None req-64a7af0d-f042-43f7-88dd-4c04856ce629 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] HTTP exception thrown: Instance 2e2eb841-906d-4ab2-b15e-63f07cf3037d could not be found. Jun 06 10:48:06.154648 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-64a7af0d-f042-43f7-88dd-4c04856ce629 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Request method failure captured: Jun 06 10:48:06.154648 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: request: DELETE /compute/v2.1/servers/2e2eb841-906d-4ab2-b15e-63f07cf3037d HTTP/1.1 Jun 06 10:48:06.154648 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: Accept: application/json Jun 06 10:48:06.154648 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: Accept-Encoding: identity Jun 06 10:48:06.154648 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: Connection: close Jun 06 10:48:06.154648 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: Content-Length: 0 Jun 06 10:48:06.154648 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: Content-Type: application/json Jun 06 10:48:06.154648 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: Host: 10.222.0.42 Jun 06 10:48:06.154648 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: Openstack-System-Scope: None Jun 06 10:48:06.154648 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: User-Agent: python-urllib3/1.26.9 Jun 06 10:48:06.154648 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Auth-Token: gAAAAABindpS5StX_xHu79Eyze6WiReBQv-1XmH_nbXfOmEXKeceOSLZM5qrKAT8lmCw6P5JEWqX6Nq9MOy22mDxxwSXFHT-nuQ59QQYMYHodXP_RU6pUiqpnXRk4PCXE--rTT-t8YJ-1daoywKB7L9jlYu_naOtOmjpMkLKZOiBTDyqPdUS4xY Jun 06 10:48:06.154648 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Domain-Id: None Jun 06 10:48:06.154648 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Domain-Name: None Jun 06 10:48:06.154648 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Identity-Status: Confirmed Jun 06 10:48:06.154648 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Is-Admin-Project: True Jun 06 10:48:06.154648 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Project-Domain-Id: default Jun 06 10:48:06.154648 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Project-Domain-Name: Default Jun 06 10:48:06.154648 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Project-Id: 92244b4ae17d49bebe621e803bd9ae58 Jun 06 10:48:06.154648 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Project-Name: tempest-AttachVolumeNegativeTest-363942965 Jun 06 10:48:06.154648 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Role: member,reader Jun 06 10:48:06.154648 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Roles: member,reader Jun 06 10:48:06.156309 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/92244b4ae17d49bebe621e803bd9ae58"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/92244b4ae17d49bebe621e803bd9ae58"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/92244b4ae17d49bebe621e803bd9ae58"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_92244b4ae17d49bebe621e803bd9ae58", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Jun 06 10:48:06.156309 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Tenant: tempest-AttachVolumeNegativeTest-363942965 Jun 06 10:48:06.156309 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Tenant-Id: 92244b4ae17d49bebe621e803bd9ae58 Jun 06 10:48:06.156309 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-363942965 Jun 06 10:48:06.156309 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-User: tempest-AttachVolumeNegativeTest-363942965-project Jun 06 10:48:06.156309 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-User-Domain-Id: default Jun 06 10:48:06.156309 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-User-Domain-Name: Default Jun 06 10:48:06.156309 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-User-Id: 7ba341ea1ac34874bbfb8b2f713aea1b Jun 06 10:48:06.156309 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-User-Name: tempest-AttachVolumeNegativeTest-363942965-project Jun 06 10:48:06.156309 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: method: > Jun 06 10:48:06.156309 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: exception: Instance 2e2eb841-906d-4ab2-b15e-63f07cf3037d could not be found. Jun 06 10:48:06.156309 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: action_args: {'id': '2e2eb841-906d-4ab2-b15e-63f07cf3037d'} Jun 06 10:48:06.157406 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 10:48:06.157406 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 10:48:06.157406 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 06 10:48:06.157406 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 06 10:48:06.157406 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 06 10:48:06.157406 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 06 10:48:06.157406 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 06 10:48:06.157406 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 06 10:48:06.157406 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 06 10:48:06.157406 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 06 10:48:06.157406 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2e2eb841-906d-4ab2-b15e-63f07cf3037d could not be found. Jun 06 10:48:06.157406 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi Jun 06 10:48:06.157406 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 10:48:06.157406 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi Jun 06 10:48:06.157406 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 10:48:06.157406 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 10:48:06.157406 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 10:48:06.157406 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 10:48:06.157406 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 10:48:06.157406 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 10:48:06.159004 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 10:48:06.159004 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 06 10:48:06.159004 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 06 10:48:06.159004 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 06 10:48:06.159004 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 06 10:48:06.159004 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 06 10:48:06.159004 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 06 10:48:06.159004 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 06 10:48:06.159004 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 06 10:48:06.159004 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2e2eb841-906d-4ab2-b15e-63f07cf3037d could not be found. Jun 06 10:48:06.159004 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi Jun 06 10:48:06.159004 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 10:48:06.159004 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi Jun 06 10:48:06.159004 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 10:48:06.159004 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 10:48:06.159004 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 10:48:06.159004 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 10:48:06.159004 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 10:48:06.159004 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2e2eb841-906d-4ab2-b15e-63f07cf3037d could not be found. Jun 06 10:48:06.159004 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi Jun 06 10:48:06.160857 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-64a7af0d-f042-43f7-88dd-4c04856ce629 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Returning 404 to user: Instance 2e2eb841-906d-4ab2-b15e-63f07cf3037d could not be found. {{(pid=129350) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 10:48:06.160857 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-64a7af0d-f042-43f7-88dd-4c04856ce629 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] 10.222.0.42 "DELETE /compute/v2.1/servers/2e2eb841-906d-4ab2-b15e-63f07cf3037d" status: 404 len: 111 microversion: 2.1 time: 0.033337 Jun 06 10:48:06.160857 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 467/950] 10.222.0.42 () {58 vars in 1238 bytes} [Mon Jun 6 10:48:06 2022] DELETE /compute/v2.1/servers/2e2eb841-906d-4ab2-b15e-63f07cf3037d => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 06 10:48:06.164818 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-56c92fea-ebb7-4abd-991c-bf7433790039 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:48:06.165459 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-56c92fea-ebb7-4abd-991c-bf7433790039 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] [instance: 2e2eb841-906d-4ab2-b15e-63f07cf3037d] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:48:06.171920 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-56c92fea-ebb7-4abd-991c-bf7433790039 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:48:06.172363 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-56c92fea-ebb7-4abd-991c-bf7433790039 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:48:06.173116 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-56c92fea-ebb7-4abd-991c-bf7433790039 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:48:06.173543 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-56c92fea-ebb7-4abd-991c-bf7433790039 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:48:06.186560 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.wsgi [None req-56c92fea-ebb7-4abd-991c-bf7433790039 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] HTTP exception thrown: Instance 2e2eb841-906d-4ab2-b15e-63f07cf3037d could not be found. Jun 06 10:48:06.188082 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-56c92fea-ebb7-4abd-991c-bf7433790039 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Request method failure captured: Jun 06 10:48:06.188082 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: request: GET /compute/v2.1/servers/2e2eb841-906d-4ab2-b15e-63f07cf3037d HTTP/1.1 Jun 06 10:48:06.188082 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: Accept: application/json Jun 06 10:48:06.188082 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: Accept-Encoding: identity Jun 06 10:48:06.188082 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: Connection: close Jun 06 10:48:06.188082 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: Content-Length: 0 Jun 06 10:48:06.188082 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: Content-Type: application/json Jun 06 10:48:06.188082 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: Host: 10.222.0.42 Jun 06 10:48:06.188082 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: Openstack-System-Scope: None Jun 06 10:48:06.188082 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: User-Agent: python-urllib3/1.26.9 Jun 06 10:48:06.188082 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Auth-Token: gAAAAABindpS5StX_xHu79Eyze6WiReBQv-1XmH_nbXfOmEXKeceOSLZM5qrKAT8lmCw6P5JEWqX6Nq9MOy22mDxxwSXFHT-nuQ59QQYMYHodXP_RU6pUiqpnXRk4PCXE--rTT-t8YJ-1daoywKB7L9jlYu_naOtOmjpMkLKZOiBTDyqPdUS4xY Jun 06 10:48:06.188082 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Domain-Id: None Jun 06 10:48:06.188082 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Domain-Name: None Jun 06 10:48:06.188082 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Identity-Status: Confirmed Jun 06 10:48:06.188082 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Is-Admin-Project: True Jun 06 10:48:06.188082 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Project-Domain-Id: default Jun 06 10:48:06.188082 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Project-Domain-Name: Default Jun 06 10:48:06.188082 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Project-Id: 92244b4ae17d49bebe621e803bd9ae58 Jun 06 10:48:06.188082 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Project-Name: tempest-AttachVolumeNegativeTest-363942965 Jun 06 10:48:06.188082 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Role: member,reader Jun 06 10:48:06.188082 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Roles: member,reader Jun 06 10:48:06.190480 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/92244b4ae17d49bebe621e803bd9ae58"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/92244b4ae17d49bebe621e803bd9ae58"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/92244b4ae17d49bebe621e803bd9ae58"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_92244b4ae17d49bebe621e803bd9ae58", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Jun 06 10:48:06.190480 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Tenant: tempest-AttachVolumeNegativeTest-363942965 Jun 06 10:48:06.190480 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Tenant-Id: 92244b4ae17d49bebe621e803bd9ae58 Jun 06 10:48:06.190480 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-363942965 Jun 06 10:48:06.190480 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-User: tempest-AttachVolumeNegativeTest-363942965-project Jun 06 10:48:06.190480 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-User-Domain-Id: default Jun 06 10:48:06.190480 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-User-Domain-Name: Default Jun 06 10:48:06.190480 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-User-Id: 7ba341ea1ac34874bbfb8b2f713aea1b Jun 06 10:48:06.190480 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-User-Name: tempest-AttachVolumeNegativeTest-363942965-project Jun 06 10:48:06.190480 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: method: > Jun 06 10:48:06.190480 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: exception: Instance 2e2eb841-906d-4ab2-b15e-63f07cf3037d could not be found. Jun 06 10:48:06.190480 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: action_args: {'id': '2e2eb841-906d-4ab2-b15e-63f07cf3037d'} Jun 06 10:48:06.191388 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 10:48:06.191388 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 10:48:06.191388 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 06 10:48:06.191388 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 06 10:48:06.191388 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 06 10:48:06.191388 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 06 10:48:06.191388 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 06 10:48:06.191388 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 06 10:48:06.191388 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 06 10:48:06.191388 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 06 10:48:06.191388 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2e2eb841-906d-4ab2-b15e-63f07cf3037d could not be found. Jun 06 10:48:06.191388 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Jun 06 10:48:06.191388 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 10:48:06.191388 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Jun 06 10:48:06.191388 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 10:48:06.191388 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 10:48:06.191388 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 10:48:06.191388 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 10:48:06.191388 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 10:48:06.191388 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 10:48:06.192644 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 10:48:06.192644 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 06 10:48:06.192644 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 06 10:48:06.192644 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 06 10:48:06.192644 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 06 10:48:06.192644 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 06 10:48:06.192644 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 06 10:48:06.192644 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2e2eb841-906d-4ab2-b15e-63f07cf3037d could not be found. Jun 06 10:48:06.192644 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Jun 06 10:48:06.192644 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 10:48:06.192644 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Jun 06 10:48:06.192644 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 10:48:06.192644 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 10:48:06.192644 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 10:48:06.192644 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 10:48:06.192644 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 10:48:06.192644 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2e2eb841-906d-4ab2-b15e-63f07cf3037d could not be found. Jun 06 10:48:06.192644 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Jun 06 10:48:06.193837 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-56c92fea-ebb7-4abd-991c-bf7433790039 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Returning 404 to user: Instance 2e2eb841-906d-4ab2-b15e-63f07cf3037d could not be found. {{(pid=129349) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 10:48:06.193837 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-56c92fea-ebb7-4abd-991c-bf7433790039 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] 10.222.0.42 "GET /compute/v2.1/servers/2e2eb841-906d-4ab2-b15e-63f07cf3037d" status: 404 len: 111 microversion: 2.1 time: 0.028500 Jun 06 10:48:06.193837 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 484/951] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:48:06 2022] GET /compute/v2.1/servers/2e2eb841-906d-4ab2-b15e-63f07cf3037d => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 06 10:48:06.198497 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-6c866879-bddc-4012-9ebf-3481dabdf862 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:48:06.199071 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-6c866879-bddc-4012-9ebf-3481dabdf862 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] [instance: 7490171a-7d11-4bb4-ad17-852fdbd2af8b] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:48:06.205113 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-6c866879-bddc-4012-9ebf-3481dabdf862 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:48:06.206164 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-6c866879-bddc-4012-9ebf-3481dabdf862 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:48:06.206930 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-6c866879-bddc-4012-9ebf-3481dabdf862 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:48:06.207358 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-6c866879-bddc-4012-9ebf-3481dabdf862 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:48:06.220479 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.wsgi [None req-6c866879-bddc-4012-9ebf-3481dabdf862 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] HTTP exception thrown: Instance 7490171a-7d11-4bb4-ad17-852fdbd2af8b could not be found. Jun 06 10:48:06.222227 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-6c866879-bddc-4012-9ebf-3481dabdf862 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Request method failure captured: Jun 06 10:48:06.222227 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: request: DELETE /compute/v2.1/servers/7490171a-7d11-4bb4-ad17-852fdbd2af8b HTTP/1.1 Jun 06 10:48:06.222227 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: Accept: application/json Jun 06 10:48:06.222227 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: Accept-Encoding: identity Jun 06 10:48:06.222227 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: Connection: close Jun 06 10:48:06.222227 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: Content-Length: 0 Jun 06 10:48:06.222227 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: Content-Type: application/json Jun 06 10:48:06.222227 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: Host: 10.222.0.42 Jun 06 10:48:06.222227 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: Openstack-System-Scope: None Jun 06 10:48:06.222227 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: User-Agent: python-urllib3/1.26.9 Jun 06 10:48:06.222227 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Auth-Token: gAAAAABindpS5StX_xHu79Eyze6WiReBQv-1XmH_nbXfOmEXKeceOSLZM5qrKAT8lmCw6P5JEWqX6Nq9MOy22mDxxwSXFHT-nuQ59QQYMYHodXP_RU6pUiqpnXRk4PCXE--rTT-t8YJ-1daoywKB7L9jlYu_naOtOmjpMkLKZOiBTDyqPdUS4xY Jun 06 10:48:06.222227 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Domain-Id: None Jun 06 10:48:06.222227 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Domain-Name: None Jun 06 10:48:06.222227 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Identity-Status: Confirmed Jun 06 10:48:06.222227 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Is-Admin-Project: True Jun 06 10:48:06.222227 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Project-Domain-Id: default Jun 06 10:48:06.222227 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Project-Domain-Name: Default Jun 06 10:48:06.222227 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Project-Id: 92244b4ae17d49bebe621e803bd9ae58 Jun 06 10:48:06.222227 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Project-Name: tempest-AttachVolumeNegativeTest-363942965 Jun 06 10:48:06.222227 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Role: member,reader Jun 06 10:48:06.222227 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Roles: member,reader Jun 06 10:48:06.223862 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/92244b4ae17d49bebe621e803bd9ae58"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/92244b4ae17d49bebe621e803bd9ae58"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/92244b4ae17d49bebe621e803bd9ae58"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_92244b4ae17d49bebe621e803bd9ae58", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Jun 06 10:48:06.223862 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Tenant: tempest-AttachVolumeNegativeTest-363942965 Jun 06 10:48:06.223862 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Tenant-Id: 92244b4ae17d49bebe621e803bd9ae58 Jun 06 10:48:06.223862 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-363942965 Jun 06 10:48:06.223862 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-User: tempest-AttachVolumeNegativeTest-363942965-project Jun 06 10:48:06.223862 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-User-Domain-Id: default Jun 06 10:48:06.223862 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-User-Domain-Name: Default Jun 06 10:48:06.223862 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-User-Id: 7ba341ea1ac34874bbfb8b2f713aea1b Jun 06 10:48:06.223862 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-User-Name: tempest-AttachVolumeNegativeTest-363942965-project Jun 06 10:48:06.223862 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: method: > Jun 06 10:48:06.223862 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: exception: Instance 7490171a-7d11-4bb4-ad17-852fdbd2af8b could not be found. Jun 06 10:48:06.223862 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: action_args: {'id': '7490171a-7d11-4bb4-ad17-852fdbd2af8b'} Jun 06 10:48:06.225029 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 10:48:06.225029 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 10:48:06.225029 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 06 10:48:06.225029 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 06 10:48:06.225029 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 06 10:48:06.225029 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 06 10:48:06.225029 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 06 10:48:06.225029 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 06 10:48:06.225029 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 06 10:48:06.225029 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 06 10:48:06.225029 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7490171a-7d11-4bb4-ad17-852fdbd2af8b could not be found. Jun 06 10:48:06.225029 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi Jun 06 10:48:06.225029 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 10:48:06.225029 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi Jun 06 10:48:06.225029 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 10:48:06.225029 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 10:48:06.225029 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 10:48:06.225029 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 10:48:06.225029 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 10:48:06.225029 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 10:48:06.226549 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 10:48:06.226549 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 06 10:48:06.226549 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 06 10:48:06.226549 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 06 10:48:06.226549 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 06 10:48:06.226549 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 06 10:48:06.226549 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 06 10:48:06.226549 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 06 10:48:06.226549 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 06 10:48:06.226549 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7490171a-7d11-4bb4-ad17-852fdbd2af8b could not be found. Jun 06 10:48:06.226549 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi Jun 06 10:48:06.226549 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 10:48:06.226549 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi Jun 06 10:48:06.226549 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 10:48:06.226549 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 10:48:06.226549 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 10:48:06.226549 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 10:48:06.226549 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 10:48:06.226549 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7490171a-7d11-4bb4-ad17-852fdbd2af8b could not be found. Jun 06 10:48:06.226549 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi Jun 06 10:48:06.228294 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-6c866879-bddc-4012-9ebf-3481dabdf862 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Returning 404 to user: Instance 7490171a-7d11-4bb4-ad17-852fdbd2af8b could not be found. {{(pid=129350) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 10:48:06.228294 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-6c866879-bddc-4012-9ebf-3481dabdf862 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] 10.222.0.42 "DELETE /compute/v2.1/servers/7490171a-7d11-4bb4-ad17-852fdbd2af8b" status: 404 len: 111 microversion: 2.1 time: 0.028950 Jun 06 10:48:06.228294 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 468/952] 10.222.0.42 () {58 vars in 1238 bytes} [Mon Jun 6 10:48:06 2022] DELETE /compute/v2.1/servers/7490171a-7d11-4bb4-ad17-852fdbd2af8b => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 06 10:48:06.232354 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-31e59c24-c709-4412-96e7-8ed4df0c04ab tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:48:06.233021 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-31e59c24-c709-4412-96e7-8ed4df0c04ab tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] [instance: 7490171a-7d11-4bb4-ad17-852fdbd2af8b] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:48:06.239171 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-31e59c24-c709-4412-96e7-8ed4df0c04ab tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:48:06.239611 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-31e59c24-c709-4412-96e7-8ed4df0c04ab tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:48:06.240407 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-31e59c24-c709-4412-96e7-8ed4df0c04ab tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:48:06.240838 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-31e59c24-c709-4412-96e7-8ed4df0c04ab tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:48:06.254531 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.wsgi [None req-31e59c24-c709-4412-96e7-8ed4df0c04ab tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] HTTP exception thrown: Instance 7490171a-7d11-4bb4-ad17-852fdbd2af8b could not be found. Jun 06 10:48:06.256065 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-31e59c24-c709-4412-96e7-8ed4df0c04ab tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Request method failure captured: Jun 06 10:48:06.256065 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: request: GET /compute/v2.1/servers/7490171a-7d11-4bb4-ad17-852fdbd2af8b HTTP/1.1 Jun 06 10:48:06.256065 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: Accept: application/json Jun 06 10:48:06.256065 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: Accept-Encoding: identity Jun 06 10:48:06.256065 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: Connection: close Jun 06 10:48:06.256065 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: Content-Length: 0 Jun 06 10:48:06.256065 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: Content-Type: application/json Jun 06 10:48:06.256065 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: Host: 10.222.0.42 Jun 06 10:48:06.256065 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: Openstack-System-Scope: None Jun 06 10:48:06.256065 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: User-Agent: python-urllib3/1.26.9 Jun 06 10:48:06.256065 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Auth-Token: gAAAAABindpS5StX_xHu79Eyze6WiReBQv-1XmH_nbXfOmEXKeceOSLZM5qrKAT8lmCw6P5JEWqX6Nq9MOy22mDxxwSXFHT-nuQ59QQYMYHodXP_RU6pUiqpnXRk4PCXE--rTT-t8YJ-1daoywKB7L9jlYu_naOtOmjpMkLKZOiBTDyqPdUS4xY Jun 06 10:48:06.256065 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Domain-Id: None Jun 06 10:48:06.256065 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Domain-Name: None Jun 06 10:48:06.256065 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Identity-Status: Confirmed Jun 06 10:48:06.256065 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Is-Admin-Project: True Jun 06 10:48:06.256065 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Project-Domain-Id: default Jun 06 10:48:06.256065 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Project-Domain-Name: Default Jun 06 10:48:06.256065 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Project-Id: 92244b4ae17d49bebe621e803bd9ae58 Jun 06 10:48:06.256065 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Project-Name: tempest-AttachVolumeNegativeTest-363942965 Jun 06 10:48:06.256065 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Role: member,reader Jun 06 10:48:06.256065 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Roles: member,reader Jun 06 10:48:06.257646 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/92244b4ae17d49bebe621e803bd9ae58"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/92244b4ae17d49bebe621e803bd9ae58"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/92244b4ae17d49bebe621e803bd9ae58"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_92244b4ae17d49bebe621e803bd9ae58", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Jun 06 10:48:06.257646 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Tenant: tempest-AttachVolumeNegativeTest-363942965 Jun 06 10:48:06.257646 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Tenant-Id: 92244b4ae17d49bebe621e803bd9ae58 Jun 06 10:48:06.257646 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-363942965 Jun 06 10:48:06.257646 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-User: tempest-AttachVolumeNegativeTest-363942965-project Jun 06 10:48:06.257646 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-User-Domain-Id: default Jun 06 10:48:06.257646 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-User-Domain-Name: Default Jun 06 10:48:06.257646 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-User-Id: 7ba341ea1ac34874bbfb8b2f713aea1b Jun 06 10:48:06.257646 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-User-Name: tempest-AttachVolumeNegativeTest-363942965-project Jun 06 10:48:06.257646 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: method: > Jun 06 10:48:06.257646 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: exception: Instance 7490171a-7d11-4bb4-ad17-852fdbd2af8b could not be found. Jun 06 10:48:06.257646 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: action_args: {'id': '7490171a-7d11-4bb4-ad17-852fdbd2af8b'} Jun 06 10:48:06.258606 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 10:48:06.258606 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 10:48:06.258606 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 06 10:48:06.258606 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 06 10:48:06.258606 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 06 10:48:06.258606 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 06 10:48:06.258606 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 06 10:48:06.258606 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 06 10:48:06.258606 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 06 10:48:06.258606 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 06 10:48:06.258606 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7490171a-7d11-4bb4-ad17-852fdbd2af8b could not be found. Jun 06 10:48:06.258606 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Jun 06 10:48:06.258606 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 10:48:06.258606 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Jun 06 10:48:06.258606 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 10:48:06.258606 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 10:48:06.258606 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 10:48:06.258606 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 10:48:06.258606 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 10:48:06.258606 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 10:48:06.260254 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 10:48:06.260254 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 06 10:48:06.260254 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 06 10:48:06.260254 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 06 10:48:06.260254 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 06 10:48:06.260254 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 06 10:48:06.260254 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 06 10:48:06.260254 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7490171a-7d11-4bb4-ad17-852fdbd2af8b could not be found. Jun 06 10:48:06.260254 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Jun 06 10:48:06.260254 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 10:48:06.260254 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Jun 06 10:48:06.260254 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 10:48:06.260254 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 10:48:06.260254 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 10:48:06.260254 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 10:48:06.260254 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 10:48:06.260254 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7490171a-7d11-4bb4-ad17-852fdbd2af8b could not be found. Jun 06 10:48:06.260254 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Jun 06 10:48:06.264515 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-31e59c24-c709-4412-96e7-8ed4df0c04ab tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Returning 404 to user: Instance 7490171a-7d11-4bb4-ad17-852fdbd2af8b could not be found. {{(pid=129349) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 10:48:06.264515 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-31e59c24-c709-4412-96e7-8ed4df0c04ab tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] 10.222.0.42 "GET /compute/v2.1/servers/7490171a-7d11-4bb4-ad17-852fdbd2af8b" status: 404 len: 111 microversion: 2.1 time: 0.029258 Jun 06 10:48:06.264515 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 485/953] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:48:06 2022] GET /compute/v2.1/servers/7490171a-7d11-4bb4-ad17-852fdbd2af8b => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 06 10:48:07.391928 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-a4b31fa4-01e7-4c19-b963-4b1624dac9ea tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:48:07.392430 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-a4b31fa4-01e7-4c19-b963-4b1624dac9ea tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] [instance: 3827eb37-6346-4a31-a6e5-25b90628827c] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:48:07.400373 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-a4b31fa4-01e7-4c19-b963-4b1624dac9ea tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:48:07.400815 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-a4b31fa4-01e7-4c19-b963-4b1624dac9ea tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:48:07.401596 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-a4b31fa4-01e7-4c19-b963-4b1624dac9ea tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:48:07.402029 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-a4b31fa4-01e7-4c19-b963-4b1624dac9ea tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:48:07.417736 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.wsgi [None req-a4b31fa4-01e7-4c19-b963-4b1624dac9ea tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] HTTP exception thrown: Instance 3827eb37-6346-4a31-a6e5-25b90628827c could not be found. Jun 06 10:48:07.419298 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-a4b31fa4-01e7-4c19-b963-4b1624dac9ea tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Request method failure captured: Jun 06 10:48:07.419298 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: request: DELETE /compute/v2.1/servers/3827eb37-6346-4a31-a6e5-25b90628827c HTTP/1.1 Jun 06 10:48:07.419298 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: Accept: application/json Jun 06 10:48:07.419298 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: Accept-Encoding: identity Jun 06 10:48:07.419298 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: Connection: close Jun 06 10:48:07.419298 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: Content-Length: 0 Jun 06 10:48:07.419298 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: Content-Type: application/json Jun 06 10:48:07.419298 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: Host: 10.222.0.42 Jun 06 10:48:07.419298 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: Openstack-System-Scope: None Jun 06 10:48:07.419298 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: User-Agent: python-urllib3/1.26.9 Jun 06 10:48:07.419298 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Auth-Token: gAAAAABindpS5StX_xHu79Eyze6WiReBQv-1XmH_nbXfOmEXKeceOSLZM5qrKAT8lmCw6P5JEWqX6Nq9MOy22mDxxwSXFHT-nuQ59QQYMYHodXP_RU6pUiqpnXRk4PCXE--rTT-t8YJ-1daoywKB7L9jlYu_naOtOmjpMkLKZOiBTDyqPdUS4xY Jun 06 10:48:07.419298 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Domain-Id: None Jun 06 10:48:07.419298 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Domain-Name: None Jun 06 10:48:07.419298 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Identity-Status: Confirmed Jun 06 10:48:07.419298 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Is-Admin-Project: True Jun 06 10:48:07.419298 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Project-Domain-Id: default Jun 06 10:48:07.419298 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Project-Domain-Name: Default Jun 06 10:48:07.419298 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Project-Id: 92244b4ae17d49bebe621e803bd9ae58 Jun 06 10:48:07.419298 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Project-Name: tempest-AttachVolumeNegativeTest-363942965 Jun 06 10:48:07.419298 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Role: member,reader Jun 06 10:48:07.419298 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Roles: member,reader Jun 06 10:48:07.420928 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/92244b4ae17d49bebe621e803bd9ae58"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/92244b4ae17d49bebe621e803bd9ae58"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/92244b4ae17d49bebe621e803bd9ae58"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_92244b4ae17d49bebe621e803bd9ae58", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Jun 06 10:48:07.420928 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Tenant: tempest-AttachVolumeNegativeTest-363942965 Jun 06 10:48:07.420928 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Tenant-Id: 92244b4ae17d49bebe621e803bd9ae58 Jun 06 10:48:07.420928 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-363942965 Jun 06 10:48:07.420928 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-User: tempest-AttachVolumeNegativeTest-363942965-project Jun 06 10:48:07.420928 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-User-Domain-Id: default Jun 06 10:48:07.420928 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-User-Domain-Name: Default Jun 06 10:48:07.420928 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-User-Id: 7ba341ea1ac34874bbfb8b2f713aea1b Jun 06 10:48:07.420928 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-User-Name: tempest-AttachVolumeNegativeTest-363942965-project Jun 06 10:48:07.420928 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: method: > Jun 06 10:48:07.420928 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: exception: Instance 3827eb37-6346-4a31-a6e5-25b90628827c could not be found. Jun 06 10:48:07.420928 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: action_args: {'id': '3827eb37-6346-4a31-a6e5-25b90628827c'} Jun 06 10:48:07.421723 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 10:48:07.421723 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 10:48:07.421723 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 06 10:48:07.421723 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 06 10:48:07.421723 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 06 10:48:07.421723 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 06 10:48:07.421723 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 06 10:48:07.421723 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 06 10:48:07.421723 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 06 10:48:07.421723 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 06 10:48:07.421723 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3827eb37-6346-4a31-a6e5-25b90628827c could not be found. Jun 06 10:48:07.421723 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi Jun 06 10:48:07.421723 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 10:48:07.421723 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi Jun 06 10:48:07.421723 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 10:48:07.421723 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 10:48:07.421723 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 10:48:07.421723 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 10:48:07.421723 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 10:48:07.421723 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 10:48:07.422989 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 10:48:07.422989 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 06 10:48:07.422989 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 06 10:48:07.422989 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 06 10:48:07.422989 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 06 10:48:07.422989 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 06 10:48:07.422989 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 06 10:48:07.422989 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 06 10:48:07.422989 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 06 10:48:07.422989 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3827eb37-6346-4a31-a6e5-25b90628827c could not be found. Jun 06 10:48:07.422989 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi Jun 06 10:48:07.422989 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 10:48:07.422989 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi Jun 06 10:48:07.422989 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 10:48:07.422989 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 10:48:07.422989 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 10:48:07.422989 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 10:48:07.422989 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 10:48:07.422989 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3827eb37-6346-4a31-a6e5-25b90628827c could not be found. Jun 06 10:48:07.422989 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi Jun 06 10:48:07.424836 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-a4b31fa4-01e7-4c19-b963-4b1624dac9ea tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Returning 404 to user: Instance 3827eb37-6346-4a31-a6e5-25b90628827c could not be found. {{(pid=129350) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 10:48:07.424836 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-a4b31fa4-01e7-4c19-b963-4b1624dac9ea tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] 10.222.0.42 "DELETE /compute/v2.1/servers/3827eb37-6346-4a31-a6e5-25b90628827c" status: 404 len: 111 microversion: 2.1 time: 0.033068 Jun 06 10:48:07.424836 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 469/954] 10.222.0.42 () {58 vars in 1238 bytes} [Mon Jun 6 10:48:07 2022] DELETE /compute/v2.1/servers/3827eb37-6346-4a31-a6e5-25b90628827c => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 06 10:48:07.430204 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-9cedf64b-5236-43a3-a67f-b0329e899882 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:48:07.430821 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-9cedf64b-5236-43a3-a67f-b0329e899882 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] [instance: 3827eb37-6346-4a31-a6e5-25b90628827c] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:48:07.434605 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG dbcounter [-] [129349] Writing DB stats nova_api:SELECT=27,nova_api:DELETE=1 {{(pid=129349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 10:48:07.438565 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-9cedf64b-5236-43a3-a67f-b0329e899882 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:48:07.439016 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-9cedf64b-5236-43a3-a67f-b0329e899882 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:48:07.439807 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-9cedf64b-5236-43a3-a67f-b0329e899882 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:48:07.441108 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-9cedf64b-5236-43a3-a67f-b0329e899882 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:48:07.456939 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.wsgi [None req-9cedf64b-5236-43a3-a67f-b0329e899882 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] HTTP exception thrown: Instance 3827eb37-6346-4a31-a6e5-25b90628827c could not be found. Jun 06 10:48:07.458680 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-9cedf64b-5236-43a3-a67f-b0329e899882 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Request method failure captured: Jun 06 10:48:07.458680 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: request: GET /compute/v2.1/servers/3827eb37-6346-4a31-a6e5-25b90628827c HTTP/1.1 Jun 06 10:48:07.458680 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: Accept: application/json Jun 06 10:48:07.458680 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: Accept-Encoding: identity Jun 06 10:48:07.458680 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: Connection: close Jun 06 10:48:07.458680 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: Content-Length: 0 Jun 06 10:48:07.458680 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: Content-Type: application/json Jun 06 10:48:07.458680 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: Host: 10.222.0.42 Jun 06 10:48:07.458680 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: Openstack-System-Scope: None Jun 06 10:48:07.458680 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: User-Agent: python-urllib3/1.26.9 Jun 06 10:48:07.458680 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Auth-Token: gAAAAABindpS5StX_xHu79Eyze6WiReBQv-1XmH_nbXfOmEXKeceOSLZM5qrKAT8lmCw6P5JEWqX6Nq9MOy22mDxxwSXFHT-nuQ59QQYMYHodXP_RU6pUiqpnXRk4PCXE--rTT-t8YJ-1daoywKB7L9jlYu_naOtOmjpMkLKZOiBTDyqPdUS4xY Jun 06 10:48:07.458680 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Domain-Id: None Jun 06 10:48:07.458680 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Domain-Name: None Jun 06 10:48:07.458680 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Identity-Status: Confirmed Jun 06 10:48:07.458680 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Is-Admin-Project: True Jun 06 10:48:07.458680 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Project-Domain-Id: default Jun 06 10:48:07.458680 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Project-Domain-Name: Default Jun 06 10:48:07.458680 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Project-Id: 92244b4ae17d49bebe621e803bd9ae58 Jun 06 10:48:07.458680 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Project-Name: tempest-AttachVolumeNegativeTest-363942965 Jun 06 10:48:07.458680 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Role: member,reader Jun 06 10:48:07.458680 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Roles: member,reader Jun 06 10:48:07.460375 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/92244b4ae17d49bebe621e803bd9ae58"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/92244b4ae17d49bebe621e803bd9ae58"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/92244b4ae17d49bebe621e803bd9ae58"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_92244b4ae17d49bebe621e803bd9ae58", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Jun 06 10:48:07.460375 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Tenant: tempest-AttachVolumeNegativeTest-363942965 Jun 06 10:48:07.460375 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Tenant-Id: 92244b4ae17d49bebe621e803bd9ae58 Jun 06 10:48:07.460375 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-363942965 Jun 06 10:48:07.460375 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-User: tempest-AttachVolumeNegativeTest-363942965-project Jun 06 10:48:07.460375 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-User-Domain-Id: default Jun 06 10:48:07.460375 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-User-Domain-Name: Default Jun 06 10:48:07.460375 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-User-Id: 7ba341ea1ac34874bbfb8b2f713aea1b Jun 06 10:48:07.460375 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-User-Name: tempest-AttachVolumeNegativeTest-363942965-project Jun 06 10:48:07.460375 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: method: > Jun 06 10:48:07.460375 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: exception: Instance 3827eb37-6346-4a31-a6e5-25b90628827c could not be found. Jun 06 10:48:07.460375 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: action_args: {'id': '3827eb37-6346-4a31-a6e5-25b90628827c'} Jun 06 10:48:07.461180 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 10:48:07.461180 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 10:48:07.461180 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 06 10:48:07.461180 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 06 10:48:07.461180 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 06 10:48:07.461180 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 06 10:48:07.461180 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 06 10:48:07.461180 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 06 10:48:07.461180 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 06 10:48:07.461180 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 06 10:48:07.461180 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3827eb37-6346-4a31-a6e5-25b90628827c could not be found. Jun 06 10:48:07.461180 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Jun 06 10:48:07.461180 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 10:48:07.461180 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Jun 06 10:48:07.461180 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 10:48:07.461180 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 10:48:07.461180 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 10:48:07.461180 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 10:48:07.461180 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 10:48:07.461180 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 10:48:07.462385 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 10:48:07.462385 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 06 10:48:07.462385 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 06 10:48:07.462385 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 06 10:48:07.462385 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 06 10:48:07.462385 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 06 10:48:07.462385 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 06 10:48:07.462385 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3827eb37-6346-4a31-a6e5-25b90628827c could not be found. Jun 06 10:48:07.462385 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Jun 06 10:48:07.462385 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 10:48:07.462385 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Jun 06 10:48:07.462385 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 10:48:07.462385 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 10:48:07.462385 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 10:48:07.462385 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 10:48:07.462385 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 10:48:07.462385 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3827eb37-6346-4a31-a6e5-25b90628827c could not be found. Jun 06 10:48:07.462385 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Jun 06 10:48:07.463534 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-9cedf64b-5236-43a3-a67f-b0329e899882 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] Returning 404 to user: Instance 3827eb37-6346-4a31-a6e5-25b90628827c could not be found. {{(pid=129349) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 10:48:07.463534 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-9cedf64b-5236-43a3-a67f-b0329e899882 tempest-AttachVolumeNegativeTest-363942965 tempest-AttachVolumeNegativeTest-363942965-project] 10.222.0.42 "GET /compute/v2.1/servers/3827eb37-6346-4a31-a6e5-25b90628827c" status: 404 len: 111 microversion: 2.1 time: 0.033939 Jun 06 10:48:07.463534 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 486/955] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:48:07 2022] GET /compute/v2.1/servers/3827eb37-6346-4a31-a6e5-25b90628827c => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 06 10:48:07.874019 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 06 10:48:07.874472 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: Mon Jun 6 10:48:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 06 10:49:45.618752 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG dbcounter [-] [129350] Writing DB stats nova_api:SELECT=5 {{(pid=129350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 10:49:45.619452 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG dbcounter [-] [129350] Writing DB stats nova_cell1:SELECT=37,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 10:49:45.623546 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-bbbf6e89-a83b-4713-8c0b-1944d4b7426a tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:49:45.624094 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-bbbf6e89-a83b-4713-8c0b-1944d4b7426a tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] [instance: 544fc9bb-04f0-453c-a7bb-962f01ed2dd8] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:49:45.631652 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-bbbf6e89-a83b-4713-8c0b-1944d4b7426a tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:49:45.632116 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-bbbf6e89-a83b-4713-8c0b-1944d4b7426a tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:49:45.632872 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-bbbf6e89-a83b-4713-8c0b-1944d4b7426a tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:49:45.633300 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-bbbf6e89-a83b-4713-8c0b-1944d4b7426a tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:49:45.658439 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-bbbf6e89-a83b-4713-8c0b-1944d4b7426a tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] [instance: 544fc9bb-04f0-453c-a7bb-962f01ed2dd8] Going to try to terminate instance {{(pid=129350) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 06 10:49:45.731747 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-bbbf6e89-a83b-4713-8c0b-1944d4b7426a tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] 10.222.0.42 "DELETE /compute/v2.1/servers/544fc9bb-04f0-453c-a7bb-962f01ed2dd8" status: 204 len: 0 microversion: 2.1 time: 0.114544 Jun 06 10:49:45.732376 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 470/956] 10.222.0.42 () {58 vars in 1238 bytes} [Mon Jun 6 10:49:45 2022] DELETE /compute/v2.1/servers/544fc9bb-04f0-453c-a7bb-962f01ed2dd8 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 06 10:49:45.739463 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG dbcounter [-] [129349] Writing DB stats nova_cell1:SELECT=25 {{(pid=129349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 10:49:45.740228 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG dbcounter [-] [129349] Writing DB stats nova_api:SELECT=1 {{(pid=129349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 10:49:45.745212 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-2d092d7f-96e8-41c2-acca-6b28b65af04c tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:49:45.745963 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-2d092d7f-96e8-41c2-acca-6b28b65af04c tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] [instance: 544fc9bb-04f0-453c-a7bb-962f01ed2dd8] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:49:45.753046 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-2d092d7f-96e8-41c2-acca-6b28b65af04c tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:49:45.753499 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-2d092d7f-96e8-41c2-acca-6b28b65af04c tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:49:45.754286 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-2d092d7f-96e8-41c2-acca-6b28b65af04c tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:49:45.754735 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-2d092d7f-96e8-41c2-acca-6b28b65af04c tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:49:45.993201 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-2d092d7f-96e8-41c2-acca-6b28b65af04c tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a7a5a9773d84145bbf611439d025dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6983c51eda664586ba62e206acfcc2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:49:46.001666 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-2d092d7f-96e8-41c2-acca-6b28b65af04c tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] 10.222.0.42 "GET /compute/v2.1/servers/544fc9bb-04f0-453c-a7bb-962f01ed2dd8" status: 200 len: 1577 microversion: 2.1 time: 0.264711 Jun 06 10:49:46.002221 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 487/957] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:49:45 2022] GET /compute/v2.1/servers/544fc9bb-04f0-453c-a7bb-962f01ed2dd8 => generated 1577 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 10:49:47.019808 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-3ba8647b-1cf7-4434-adf0-58eff0ae66ce tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:49:47.020494 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-3ba8647b-1cf7-4434-adf0-58eff0ae66ce tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] [instance: 544fc9bb-04f0-453c-a7bb-962f01ed2dd8] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:49:47.027051 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-3ba8647b-1cf7-4434-adf0-58eff0ae66ce tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:49:47.027498 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-3ba8647b-1cf7-4434-adf0-58eff0ae66ce tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:49:47.028305 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-3ba8647b-1cf7-4434-adf0-58eff0ae66ce tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:49:47.028738 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-3ba8647b-1cf7-4434-adf0-58eff0ae66ce tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:49:47.211595 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-3ba8647b-1cf7-4434-adf0-58eff0ae66ce tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a7a5a9773d84145bbf611439d025dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6983c51eda664586ba62e206acfcc2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:49:47.219230 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-3ba8647b-1cf7-4434-adf0-58eff0ae66ce tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] 10.222.0.42 "GET /compute/v2.1/servers/544fc9bb-04f0-453c-a7bb-962f01ed2dd8" status: 200 len: 1577 microversion: 2.1 time: 0.204043 Jun 06 10:49:47.219915 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 471/958] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:49:47 2022] GET /compute/v2.1/servers/544fc9bb-04f0-453c-a7bb-962f01ed2dd8 => generated 1577 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:49:48.105373 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [req-72a4cef1-cd74-4b96-b743-7ffd9a484965 req-84f11d40-d1d4-484b-af7e-5b91cd435172 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "544fc9bb-04f0-453c-a7bb-962f01ed2dd8", "name": "network-vif-deleted", "tag": "8abb5193-66bd-4d14-8ab2-9e216f171f63"}]} {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 10:49:48.114695 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [req-72a4cef1-cd74-4b96-b743-7ffd9a484965 req-84f11d40-d1d4-484b-af7e-5b91cd435172 service nova] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:49:48.115143 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [req-72a4cef1-cd74-4b96-b743-7ffd9a484965 req-84f11d40-d1d4-484b-af7e-5b91cd435172 service nova] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:49:48.127961 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.compute.server_external_events [req-72a4cef1-cd74-4b96-b743-7ffd9a484965 req-84f11d40-d1d4-484b-af7e-5b91cd435172 service nova] Creating event network-vif-deleted:8abb5193-66bd-4d14-8ab2-9e216f171f63 for instance 544fc9bb-04f0-453c-a7bb-962f01ed2dd8 on hv-cinder-84482 Jun 06 10:49:48.134239 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [req-72a4cef1-cd74-4b96-b743-7ffd9a484965 req-84f11d40-d1d4-484b-af7e-5b91cd435172 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100691 Jun 06 10:49:48.135485 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 488/959] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Jun 6 10:49:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 10:49:48.237413 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-d28aee8c-55fd-4d02-9e4f-fbf84cb7f84e tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:49:48.239313 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-d28aee8c-55fd-4d02-9e4f-fbf84cb7f84e tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] [instance: 544fc9bb-04f0-453c-a7bb-962f01ed2dd8] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:49:48.245863 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-d28aee8c-55fd-4d02-9e4f-fbf84cb7f84e tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:49:48.246564 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-d28aee8c-55fd-4d02-9e4f-fbf84cb7f84e tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:49:48.247499 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-d28aee8c-55fd-4d02-9e4f-fbf84cb7f84e tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:49:48.248123 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-d28aee8c-55fd-4d02-9e4f-fbf84cb7f84e tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:49:48.332864 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-d28aee8c-55fd-4d02-9e4f-fbf84cb7f84e tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a7a5a9773d84145bbf611439d025dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6983c51eda664586ba62e206acfcc2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:49:48.352197 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-d28aee8c-55fd-4d02-9e4f-fbf84cb7f84e tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] 10.222.0.42 "GET /compute/v2.1/servers/544fc9bb-04f0-453c-a7bb-962f01ed2dd8" status: 200 len: 1226 microversion: 2.1 time: 0.118481 Jun 06 10:49:48.352581 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 472/960] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:49:48 2022] GET /compute/v2.1/servers/544fc9bb-04f0-453c-a7bb-962f01ed2dd8 => generated 1226 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:49:49.370785 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-60e293f7-7ead-4e41-9670-432f6c85be30 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:49:49.371428 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-60e293f7-7ead-4e41-9670-432f6c85be30 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] [instance: 544fc9bb-04f0-453c-a7bb-962f01ed2dd8] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:49:49.377879 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-60e293f7-7ead-4e41-9670-432f6c85be30 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:49:49.378328 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-60e293f7-7ead-4e41-9670-432f6c85be30 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:49:49.380037 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-60e293f7-7ead-4e41-9670-432f6c85be30 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:49:49.380037 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-60e293f7-7ead-4e41-9670-432f6c85be30 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:49:49.393881 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.wsgi [None req-60e293f7-7ead-4e41-9670-432f6c85be30 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] HTTP exception thrown: Instance 544fc9bb-04f0-453c-a7bb-962f01ed2dd8 could not be found. Jun 06 10:49:49.396356 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-60e293f7-7ead-4e41-9670-432f6c85be30 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Request method failure captured: Jun 06 10:49:49.396356 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: request: GET /compute/v2.1/servers/544fc9bb-04f0-453c-a7bb-962f01ed2dd8 HTTP/1.1 Jun 06 10:49:49.396356 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: Accept: application/json Jun 06 10:49:49.396356 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: Accept-Encoding: identity Jun 06 10:49:49.396356 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: Connection: close Jun 06 10:49:49.396356 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: Content-Length: 0 Jun 06 10:49:49.396356 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: Content-Type: application/json Jun 06 10:49:49.396356 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: Host: 10.222.0.42 Jun 06 10:49:49.396356 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: Openstack-System-Scope: None Jun 06 10:49:49.396356 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: User-Agent: python-urllib3/1.26.9 Jun 06 10:49:49.396356 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Auth-Token: gAAAAABindskOhnFjz92ngoBqEtwV4ZYzw5HwXxT8-fIYoGAXWuY7zBj8RG-thsHVQoTt29dfAjOQHYDE1c8IyyByGVfd2r2g4NhSuRYD6Lz3mVXOff0jPHEwgaN2hAEumoRzE3M76gdLEwLV3xwbgKtkPLU0AEmXGPXp2fXxRNAsDM_YbutL-s Jun 06 10:49:49.396356 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Domain-Id: None Jun 06 10:49:49.396356 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Domain-Name: None Jun 06 10:49:49.396356 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Identity-Status: Confirmed Jun 06 10:49:49.396356 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Is-Admin-Project: True Jun 06 10:49:49.396356 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Project-Domain-Id: default Jun 06 10:49:49.396356 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Project-Domain-Name: Default Jun 06 10:49:49.396356 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Project-Id: 6983c51eda664586ba62e206acfcc2d9 Jun 06 10:49:49.396356 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Project-Name: tempest-TestVolumeBootPattern-1591397316 Jun 06 10:49:49.396356 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Role: member,reader Jun 06 10:49:49.396356 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Roles: member,reader Jun 06 10:49:49.398052 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/6983c51eda664586ba62e206acfcc2d9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/6983c51eda664586ba62e206acfcc2d9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/6983c51eda664586ba62e206acfcc2d9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_6983c51eda664586ba62e206acfcc2d9", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Jun 06 10:49:49.398052 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Tenant: tempest-TestVolumeBootPattern-1591397316 Jun 06 10:49:49.398052 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Tenant-Id: 6983c51eda664586ba62e206acfcc2d9 Jun 06 10:49:49.398052 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Tenant-Name: tempest-TestVolumeBootPattern-1591397316 Jun 06 10:49:49.398052 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-User: tempest-TestVolumeBootPattern-1591397316-project Jun 06 10:49:49.398052 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-User-Domain-Id: default Jun 06 10:49:49.398052 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-User-Domain-Name: Default Jun 06 10:49:49.398052 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-User-Id: 8a7a5a9773d84145bbf611439d025dd8 Jun 06 10:49:49.398052 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-User-Name: tempest-TestVolumeBootPattern-1591397316-project Jun 06 10:49:49.398052 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: method: > Jun 06 10:49:49.398052 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: exception: Instance 544fc9bb-04f0-453c-a7bb-962f01ed2dd8 could not be found. Jun 06 10:49:49.398052 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: action_args: {'id': '544fc9bb-04f0-453c-a7bb-962f01ed2dd8'} Jun 06 10:49:49.399047 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 10:49:49.399047 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 10:49:49.399047 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 06 10:49:49.399047 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 06 10:49:49.399047 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 06 10:49:49.399047 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 06 10:49:49.399047 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 06 10:49:49.399047 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 06 10:49:49.399047 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 06 10:49:49.399047 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 06 10:49:49.399047 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 544fc9bb-04f0-453c-a7bb-962f01ed2dd8 could not be found. Jun 06 10:49:49.399047 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Jun 06 10:49:49.399047 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 10:49:49.399047 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Jun 06 10:49:49.399047 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 10:49:49.399047 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 10:49:49.399047 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 10:49:49.399047 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 10:49:49.399047 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 10:49:49.399047 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 10:49:49.400771 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 10:49:49.400771 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 06 10:49:49.400771 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 06 10:49:49.400771 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 06 10:49:49.400771 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 06 10:49:49.400771 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 06 10:49:49.400771 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 06 10:49:49.400771 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 544fc9bb-04f0-453c-a7bb-962f01ed2dd8 could not be found. Jun 06 10:49:49.400771 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Jun 06 10:49:49.400771 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 10:49:49.400771 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Jun 06 10:49:49.400771 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 10:49:49.400771 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 10:49:49.400771 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 10:49:49.400771 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 10:49:49.400771 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 10:49:49.400771 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 544fc9bb-04f0-453c-a7bb-962f01ed2dd8 could not be found. Jun 06 10:49:49.400771 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Jun 06 10:49:49.402231 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-60e293f7-7ead-4e41-9670-432f6c85be30 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Returning 404 to user: Instance 544fc9bb-04f0-453c-a7bb-962f01ed2dd8 could not be found. {{(pid=129349) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 10:49:49.402231 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-60e293f7-7ead-4e41-9670-432f6c85be30 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] 10.222.0.42 "GET /compute/v2.1/servers/544fc9bb-04f0-453c-a7bb-962f01ed2dd8" status: 404 len: 111 microversion: 2.1 time: 0.032730 Jun 06 10:49:49.402231 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 489/961] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:49:49 2022] GET /compute/v2.1/servers/544fc9bb-04f0-453c-a7bb-962f01ed2dd8 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 06 10:49:49.490599 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-5115b26f-3b1b-4c13-a7c6-7f5ea12fa28e tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-2119097362", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1544406201", "security_groups": [{"name": "tempest-secgroup-smoke-2130332908"}], "block_device_mapping_v2": [{"uuid": "b903ecb5-7213-4cf9-86ab-b9ec46e871db", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "9c358abd-588b-47b2-9ff6-6faded31ee83"}]}} {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 10:49:49.602895 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.network.neutron [None req-5115b26f-3b1b-4c13-a7c6-7f5ea12fa28e tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] validate_networks() for [('9c358abd-588b-47b2-9ff6-6faded31ee83', None, None, None, None, None)] {{(pid=129350) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 06 10:49:50.021035 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.virt.hardware [None req-5115b26f-3b1b-4c13-a7c6-7f5ea12fa28e tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Flavor limits 0:0:0 {{(pid=129350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 06 10:49:50.021449 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.virt.hardware [None req-5115b26f-3b1b-4c13-a7c6-7f5ea12fa28e tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Image limits 0:0:0 {{(pid=129350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 06 10:49:50.021911 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.virt.hardware [None req-5115b26f-3b1b-4c13-a7c6-7f5ea12fa28e tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Flavor pref 0:0:0 {{(pid=129350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 06 10:49:50.022337 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.virt.hardware [None req-5115b26f-3b1b-4c13-a7c6-7f5ea12fa28e tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Image pref 0:0:0 {{(pid=129350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 06 10:49:50.022743 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.virt.hardware [None req-5115b26f-3b1b-4c13-a7c6-7f5ea12fa28e tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 06 10:49:50.031291 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-5115b26f-3b1b-4c13-a7c6-7f5ea12fa28e tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:49:50.031729 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-5115b26f-3b1b-4c13-a7c6-7f5ea12fa28e tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:49:50.032546 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-5115b26f-3b1b-4c13-a7c6-7f5ea12fa28e tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:49:50.032971 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-5115b26f-3b1b-4c13-a7c6-7f5ea12fa28e tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:49:50.049569 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.quota [None req-5115b26f-3b1b-4c13-a7c6-7f5ea12fa28e tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Getting quotas for project 6983c51eda664586ba62e206acfcc2d9. Resources: {'ram', 'cores', 'instances'} {{(pid=129350) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 06 10:49:50.054099 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.quota [None req-5115b26f-3b1b-4c13-a7c6-7f5ea12fa28e tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Getting quotas for user 8a7a5a9773d84145bbf611439d025dd8 and project 6983c51eda664586ba62e206acfcc2d9. Resources: {'ram', 'cores', 'instances'} {{(pid=129350) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 06 10:49:50.110351 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-5115b26f-3b1b-4c13-a7c6-7f5ea12fa28e tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Going to run 1 instances... {{(pid=129350) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 06 10:49:50.112621 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-5115b26f-3b1b-4c13-a7c6-7f5ea12fa28e tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] [instance: 9f9f1452-525b-45a2-b131-5ccbddab15a0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='b903ecb5-7213-4cf9-86ab-b9ec46e871db',volume_size=None,volume_type=None)] {{(pid=129350) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 06 10:49:50.239505 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-5115b26f-3b1b-4c13-a7c6-7f5ea12fa28e tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.752903 Jun 06 10:49:50.240184 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 473/962] 10.222.0.42 () {60 vars in 1146 bytes} [Mon Jun 6 10:49:49 2022] POST /compute/v2.1/servers => generated 406 bytes in 754 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 06 10:49:50.249932 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-dcdf5768-b2f4-45ac-a5d6-f4e7e294102f tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:49:50.250551 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-dcdf5768-b2f4-45ac-a5d6-f4e7e294102f tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] [instance: 9f9f1452-525b-45a2-b131-5ccbddab15a0] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:49:50.303794 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-dcdf5768-b2f4-45ac-a5d6-f4e7e294102f tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a7a5a9773d84145bbf611439d025dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6983c51eda664586ba62e206acfcc2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:49:50.310549 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-dcdf5768-b2f4-45ac-a5d6-f4e7e294102f tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] 10.222.0.42 "GET /compute/v2.1/servers/9f9f1452-525b-45a2-b131-5ccbddab15a0" status: 200 len: 1095 microversion: 2.1 time: 0.064433 Jun 06 10:49:50.311289 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 490/963] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:49:50 2022] GET /compute/v2.1/servers/9f9f1452-525b-45a2-b131-5ccbddab15a0 => generated 1095 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:49:51.327432 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-26a18798-57e7-4a8d-872d-02b3360f2332 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:49:51.328015 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-26a18798-57e7-4a8d-872d-02b3360f2332 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] [instance: 9f9f1452-525b-45a2-b131-5ccbddab15a0] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:49:51.391112 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-26a18798-57e7-4a8d-872d-02b3360f2332 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a7a5a9773d84145bbf611439d025dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6983c51eda664586ba62e206acfcc2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:49:51.399431 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-26a18798-57e7-4a8d-872d-02b3360f2332 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] 10.222.0.42 "GET /compute/v2.1/servers/9f9f1452-525b-45a2-b131-5ccbddab15a0" status: 200 len: 1095 microversion: 2.1 time: 0.075836 Jun 06 10:49:51.400212 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 474/964] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:49:51 2022] GET /compute/v2.1/servers/9f9f1452-525b-45a2-b131-5ccbddab15a0 => generated 1095 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:49:52.415919 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-b5dc70a8-f752-43b6-af24-081426f4ff85 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:49:52.416538 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-b5dc70a8-f752-43b6-af24-081426f4ff85 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] [instance: 9f9f1452-525b-45a2-b131-5ccbddab15a0] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:49:52.470855 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-b5dc70a8-f752-43b6-af24-081426f4ff85 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a7a5a9773d84145bbf611439d025dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6983c51eda664586ba62e206acfcc2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:49:52.477625 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-b5dc70a8-f752-43b6-af24-081426f4ff85 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] 10.222.0.42 "GET /compute/v2.1/servers/9f9f1452-525b-45a2-b131-5ccbddab15a0" status: 200 len: 1095 microversion: 2.1 time: 0.065589 Jun 06 10:49:52.478200 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 491/965] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:49:52 2022] GET /compute/v2.1/servers/9f9f1452-525b-45a2-b131-5ccbddab15a0 => generated 1095 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 10:49:53.494375 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-0b5ba665-5794-41cb-b74e-8972b4e3286d tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:49:53.494985 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-0b5ba665-5794-41cb-b74e-8972b4e3286d tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] [instance: 9f9f1452-525b-45a2-b131-5ccbddab15a0] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:49:53.546581 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-0b5ba665-5794-41cb-b74e-8972b4e3286d tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a7a5a9773d84145bbf611439d025dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6983c51eda664586ba62e206acfcc2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:49:53.553230 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-0b5ba665-5794-41cb-b74e-8972b4e3286d tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] 10.222.0.42 "GET /compute/v2.1/servers/9f9f1452-525b-45a2-b131-5ccbddab15a0" status: 200 len: 1095 microversion: 2.1 time: 0.062762 Jun 06 10:49:53.553791 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 475/966] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:49:53 2022] GET /compute/v2.1/servers/9f9f1452-525b-45a2-b131-5ccbddab15a0 => generated 1095 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 10:49:54.570159 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-cf9d3e6b-6a5c-4a9b-9a17-268dc6ed7f86 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:49:54.570727 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-cf9d3e6b-6a5c-4a9b-9a17-268dc6ed7f86 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] [instance: 9f9f1452-525b-45a2-b131-5ccbddab15a0] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:49:54.577149 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-cf9d3e6b-6a5c-4a9b-9a17-268dc6ed7f86 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:49:54.577587 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-cf9d3e6b-6a5c-4a9b-9a17-268dc6ed7f86 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:49:54.578342 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-cf9d3e6b-6a5c-4a9b-9a17-268dc6ed7f86 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:49:54.578769 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-cf9d3e6b-6a5c-4a9b-9a17-268dc6ed7f86 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:49:54.638242 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-cf9d3e6b-6a5c-4a9b-9a17-268dc6ed7f86 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a7a5a9773d84145bbf611439d025dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6983c51eda664586ba62e206acfcc2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:49:54.646383 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-cf9d3e6b-6a5c-4a9b-9a17-268dc6ed7f86 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] 10.222.0.42 "GET /compute/v2.1/servers/9f9f1452-525b-45a2-b131-5ccbddab15a0" status: 200 len: 1145 microversion: 2.1 time: 0.080368 Jun 06 10:49:54.646932 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 492/967] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:49:54 2022] GET /compute/v2.1/servers/9f9f1452-525b-45a2-b131-5ccbddab15a0 => generated 1145 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:49:54.709408 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 06 10:49:54.709950 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: Mon Jun 6 10:49:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 06 10:49:55.663555 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-43892f5d-6e86-4639-8a5b-1f5e6a544305 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:49:55.664345 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-43892f5d-6e86-4639-8a5b-1f5e6a544305 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] [instance: 9f9f1452-525b-45a2-b131-5ccbddab15a0] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:49:55.673077 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-43892f5d-6e86-4639-8a5b-1f5e6a544305 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:49:55.673529 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-43892f5d-6e86-4639-8a5b-1f5e6a544305 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:49:55.674313 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-43892f5d-6e86-4639-8a5b-1f5e6a544305 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:49:55.674940 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-43892f5d-6e86-4639-8a5b-1f5e6a544305 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:49:55.756776 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-43892f5d-6e86-4639-8a5b-1f5e6a544305 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a7a5a9773d84145bbf611439d025dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6983c51eda664586ba62e206acfcc2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:49:55.765949 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-43892f5d-6e86-4639-8a5b-1f5e6a544305 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] 10.222.0.42 "GET /compute/v2.1/servers/9f9f1452-525b-45a2-b131-5ccbddab15a0" status: 200 len: 1211 microversion: 2.1 time: 0.107348 Jun 06 10:49:55.766677 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 476/968] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:49:55 2022] GET /compute/v2.1/servers/9f9f1452-525b-45a2-b131-5ccbddab15a0 => generated 1211 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:49:56.784638 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-9c9b1460-0f01-4fce-b0ac-134edb4a038d tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:49:56.785260 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-9c9b1460-0f01-4fce-b0ac-134edb4a038d tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] [instance: 9f9f1452-525b-45a2-b131-5ccbddab15a0] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:49:56.791808 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-9c9b1460-0f01-4fce-b0ac-134edb4a038d tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:49:56.792334 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-9c9b1460-0f01-4fce-b0ac-134edb4a038d tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:49:56.793115 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-9c9b1460-0f01-4fce-b0ac-134edb4a038d tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:49:56.793555 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-9c9b1460-0f01-4fce-b0ac-134edb4a038d tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:49:56.866998 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [req-497d5199-09d7-4ea0-bdb1-5cfb4bb91eb1 req-d2ca080c-7957-4bbc-a04a-67b4706b7cc5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9f9f1452-525b-45a2-b131-5ccbddab15a0", "tag": "a5bcd46b-b585-4fa0-966c-9dcec1fda806"}]} {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 10:49:56.883479 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [req-497d5199-09d7-4ea0-bdb1-5cfb4bb91eb1 req-d2ca080c-7957-4bbc-a04a-67b4706b7cc5 service nova] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:49:56.883967 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [req-497d5199-09d7-4ea0-bdb1-5cfb4bb91eb1 req-d2ca080c-7957-4bbc-a04a-67b4706b7cc5 service nova] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:49:56.897439 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.compute.server_external_events [req-497d5199-09d7-4ea0-bdb1-5cfb4bb91eb1 req-d2ca080c-7957-4bbc-a04a-67b4706b7cc5 service nova] Creating event network-changed:a5bcd46b-b585-4fa0-966c-9dcec1fda806 for instance 9f9f1452-525b-45a2-b131-5ccbddab15a0 on hv-cinder-84482 Jun 06 10:49:56.903721 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [req-497d5199-09d7-4ea0-bdb1-5cfb4bb91eb1 req-d2ca080c-7957-4bbc-a04a-67b4706b7cc5 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041601 Jun 06 10:49:56.904913 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 477/969] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Jun 6 10:49:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 06 10:49:56.947549 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-9c9b1460-0f01-4fce-b0ac-134edb4a038d tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a7a5a9773d84145bbf611439d025dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6983c51eda664586ba62e206acfcc2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:49:56.955825 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-9c9b1460-0f01-4fce-b0ac-134edb4a038d tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] 10.222.0.42 "GET /compute/v2.1/servers/9f9f1452-525b-45a2-b131-5ccbddab15a0" status: 200 len: 1267 microversion: 2.1 time: 0.174907 Jun 06 10:49:56.956437 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 493/970] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:49:56 2022] GET /compute/v2.1/servers/9f9f1452-525b-45a2-b131-5ccbddab15a0 => generated 1267 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:49:57.974258 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-cea58d62-adb2-41c5-9fc2-e4e3e2d61af5 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:49:57.975032 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-cea58d62-adb2-41c5-9fc2-e4e3e2d61af5 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] [instance: 9f9f1452-525b-45a2-b131-5ccbddab15a0] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:49:57.981189 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-cea58d62-adb2-41c5-9fc2-e4e3e2d61af5 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:49:57.981629 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-cea58d62-adb2-41c5-9fc2-e4e3e2d61af5 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:49:57.982388 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-cea58d62-adb2-41c5-9fc2-e4e3e2d61af5 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:49:57.982820 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-cea58d62-adb2-41c5-9fc2-e4e3e2d61af5 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:49:58.110066 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-cea58d62-adb2-41c5-9fc2-e4e3e2d61af5 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a7a5a9773d84145bbf611439d025dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6983c51eda664586ba62e206acfcc2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:49:58.118437 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-cea58d62-adb2-41c5-9fc2-e4e3e2d61af5 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] 10.222.0.42 "GET /compute/v2.1/servers/9f9f1452-525b-45a2-b131-5ccbddab15a0" status: 200 len: 1267 microversion: 2.1 time: 0.148988 Jun 06 10:49:58.118993 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 478/971] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:49:57 2022] GET /compute/v2.1/servers/9f9f1452-525b-45a2-b131-5ccbddab15a0 => generated 1267 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:49:59.134366 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-d4df8476-2b67-4277-908d-6b6122e7ac9f tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:49:59.134977 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-d4df8476-2b67-4277-908d-6b6122e7ac9f tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] [instance: 9f9f1452-525b-45a2-b131-5ccbddab15a0] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:49:59.141406 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-d4df8476-2b67-4277-908d-6b6122e7ac9f tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:49:59.141842 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-d4df8476-2b67-4277-908d-6b6122e7ac9f tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:49:59.142840 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-d4df8476-2b67-4277-908d-6b6122e7ac9f tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:49:59.143275 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-d4df8476-2b67-4277-908d-6b6122e7ac9f tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:49:59.275410 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-d4df8476-2b67-4277-908d-6b6122e7ac9f tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a7a5a9773d84145bbf611439d025dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6983c51eda664586ba62e206acfcc2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:49:59.282733 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-d4df8476-2b67-4277-908d-6b6122e7ac9f tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] 10.222.0.42 "GET /compute/v2.1/servers/9f9f1452-525b-45a2-b131-5ccbddab15a0" status: 200 len: 1267 microversion: 2.1 time: 0.152221 Jun 06 10:49:59.283298 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 494/972] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:49:59 2022] GET /compute/v2.1/servers/9f9f1452-525b-45a2-b131-5ccbddab15a0 => generated 1267 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:50:00.299335 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-6e737eec-e352-4505-b7bf-b8c91106a0d4 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:50:00.299994 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-6e737eec-e352-4505-b7bf-b8c91106a0d4 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] [instance: 9f9f1452-525b-45a2-b131-5ccbddab15a0] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:50:00.303119 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG dbcounter [-] [129350] Writing DB stats nova_cell0:SELECT=2 {{(pid=129350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 10:50:00.308680 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-6e737eec-e352-4505-b7bf-b8c91106a0d4 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:50:00.309135 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-6e737eec-e352-4505-b7bf-b8c91106a0d4 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:50:00.309897 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-6e737eec-e352-4505-b7bf-b8c91106a0d4 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:50:00.310334 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-6e737eec-e352-4505-b7bf-b8c91106a0d4 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:50:00.451003 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-6e737eec-e352-4505-b7bf-b8c91106a0d4 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a7a5a9773d84145bbf611439d025dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6983c51eda664586ba62e206acfcc2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:50:00.458853 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-6e737eec-e352-4505-b7bf-b8c91106a0d4 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] 10.222.0.42 "GET /compute/v2.1/servers/9f9f1452-525b-45a2-b131-5ccbddab15a0" status: 200 len: 1267 microversion: 2.1 time: 0.163412 Jun 06 10:50:00.459412 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 479/973] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:50:00 2022] GET /compute/v2.1/servers/9f9f1452-525b-45a2-b131-5ccbddab15a0 => generated 1267 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:50:01.475809 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-47a5e8e2-afd1-4fb1-8c8e-e0c0e0b7adf5 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:50:01.476420 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-47a5e8e2-afd1-4fb1-8c8e-e0c0e0b7adf5 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] [instance: 9f9f1452-525b-45a2-b131-5ccbddab15a0] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:50:01.482933 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-47a5e8e2-afd1-4fb1-8c8e-e0c0e0b7adf5 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:50:01.483379 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-47a5e8e2-afd1-4fb1-8c8e-e0c0e0b7adf5 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:50:01.484173 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-47a5e8e2-afd1-4fb1-8c8e-e0c0e0b7adf5 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:50:01.484609 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-47a5e8e2-afd1-4fb1-8c8e-e0c0e0b7adf5 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:50:01.617298 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-47a5e8e2-afd1-4fb1-8c8e-e0c0e0b7adf5 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a7a5a9773d84145bbf611439d025dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6983c51eda664586ba62e206acfcc2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:50:01.625409 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-47a5e8e2-afd1-4fb1-8c8e-e0c0e0b7adf5 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] 10.222.0.42 "GET /compute/v2.1/servers/9f9f1452-525b-45a2-b131-5ccbddab15a0" status: 200 len: 1267 microversion: 2.1 time: 0.153637 Jun 06 10:50:01.625979 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 495/974] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:50:01 2022] GET /compute/v2.1/servers/9f9f1452-525b-45a2-b131-5ccbddab15a0 => generated 1267 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:50:02.643283 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-afa317aa-e392-451c-a61b-c032387dd1bc tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:50:02.643903 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-afa317aa-e392-451c-a61b-c032387dd1bc tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] [instance: 9f9f1452-525b-45a2-b131-5ccbddab15a0] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:50:02.650425 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-afa317aa-e392-451c-a61b-c032387dd1bc tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:50:02.650872 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-afa317aa-e392-451c-a61b-c032387dd1bc tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:50:02.651632 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-afa317aa-e392-451c-a61b-c032387dd1bc tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:50:02.652101 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-afa317aa-e392-451c-a61b-c032387dd1bc tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:50:02.780473 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-afa317aa-e392-451c-a61b-c032387dd1bc tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a7a5a9773d84145bbf611439d025dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6983c51eda664586ba62e206acfcc2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:50:02.787870 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-afa317aa-e392-451c-a61b-c032387dd1bc tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] 10.222.0.42 "GET /compute/v2.1/servers/9f9f1452-525b-45a2-b131-5ccbddab15a0" status: 200 len: 1267 microversion: 2.1 time: 0.148735 Jun 06 10:50:02.788429 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 480/975] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:50:02 2022] GET /compute/v2.1/servers/9f9f1452-525b-45a2-b131-5ccbddab15a0 => generated 1267 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:50:03.804689 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-1c94ae80-acdf-43e7-b0a6-e082fc1affe7 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:50:03.805307 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-1c94ae80-acdf-43e7-b0a6-e082fc1affe7 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] [instance: 9f9f1452-525b-45a2-b131-5ccbddab15a0] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:50:03.807252 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG dbcounter [-] [129349] Writing DB stats nova_cell0:SELECT=4 {{(pid=129349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 10:50:03.813020 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-1c94ae80-acdf-43e7-b0a6-e082fc1affe7 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:50:03.813464 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-1c94ae80-acdf-43e7-b0a6-e082fc1affe7 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:50:03.814224 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-1c94ae80-acdf-43e7-b0a6-e082fc1affe7 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:50:03.814689 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-1c94ae80-acdf-43e7-b0a6-e082fc1affe7 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:50:03.942852 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-1c94ae80-acdf-43e7-b0a6-e082fc1affe7 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a7a5a9773d84145bbf611439d025dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6983c51eda664586ba62e206acfcc2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:50:03.950164 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-1c94ae80-acdf-43e7-b0a6-e082fc1affe7 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] 10.222.0.42 "GET /compute/v2.1/servers/9f9f1452-525b-45a2-b131-5ccbddab15a0" status: 200 len: 1267 microversion: 2.1 time: 0.150346 Jun 06 10:50:03.950718 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 496/976] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:50:03 2022] GET /compute/v2.1/servers/9f9f1452-525b-45a2-b131-5ccbddab15a0 => generated 1267 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:50:04.966411 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-78467c21-b3f5-4aa6-8a29-4d76662b325d tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:50:04.967047 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-78467c21-b3f5-4aa6-8a29-4d76662b325d tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] [instance: 9f9f1452-525b-45a2-b131-5ccbddab15a0] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:50:04.968931 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG dbcounter [-] [129350] Writing DB stats nova_cell0:SELECT=10 {{(pid=129350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 10:50:04.975706 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-78467c21-b3f5-4aa6-8a29-4d76662b325d tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:50:04.976204 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-78467c21-b3f5-4aa6-8a29-4d76662b325d tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:50:04.977034 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-78467c21-b3f5-4aa6-8a29-4d76662b325d tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:50:04.977474 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-78467c21-b3f5-4aa6-8a29-4d76662b325d tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:50:05.113391 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-78467c21-b3f5-4aa6-8a29-4d76662b325d tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a7a5a9773d84145bbf611439d025dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6983c51eda664586ba62e206acfcc2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:50:05.121669 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-78467c21-b3f5-4aa6-8a29-4d76662b325d tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] 10.222.0.42 "GET /compute/v2.1/servers/9f9f1452-525b-45a2-b131-5ccbddab15a0" status: 200 len: 1267 microversion: 2.1 time: 0.159193 Jun 06 10:50:05.122220 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 481/977] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:50:04 2022] GET /compute/v2.1/servers/9f9f1452-525b-45a2-b131-5ccbddab15a0 => generated 1267 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:50:06.139309 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-ff517d46-aa57-4840-bc02-62896807431b tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:50:06.139942 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-ff517d46-aa57-4840-bc02-62896807431b tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] [instance: 9f9f1452-525b-45a2-b131-5ccbddab15a0] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:50:06.147890 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-ff517d46-aa57-4840-bc02-62896807431b tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:50:06.148334 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-ff517d46-aa57-4840-bc02-62896807431b tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:50:06.149089 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-ff517d46-aa57-4840-bc02-62896807431b tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:50:06.149519 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-ff517d46-aa57-4840-bc02-62896807431b tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:50:06.281070 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-ff517d46-aa57-4840-bc02-62896807431b tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a7a5a9773d84145bbf611439d025dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6983c51eda664586ba62e206acfcc2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:50:06.289117 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-ff517d46-aa57-4840-bc02-62896807431b tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] 10.222.0.42 "GET /compute/v2.1/servers/9f9f1452-525b-45a2-b131-5ccbddab15a0" status: 200 len: 1267 microversion: 2.1 time: 0.153686 Jun 06 10:50:06.289686 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 497/978] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:50:06 2022] GET /compute/v2.1/servers/9f9f1452-525b-45a2-b131-5ccbddab15a0 => generated 1267 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:50:07.306827 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-120fe5c0-44e5-4d1f-85eb-caab98c58006 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:50:07.307388 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-120fe5c0-44e5-4d1f-85eb-caab98c58006 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] [instance: 9f9f1452-525b-45a2-b131-5ccbddab15a0] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:50:07.313858 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-120fe5c0-44e5-4d1f-85eb-caab98c58006 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:50:07.314301 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-120fe5c0-44e5-4d1f-85eb-caab98c58006 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:50:07.315055 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-120fe5c0-44e5-4d1f-85eb-caab98c58006 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:50:07.315484 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-120fe5c0-44e5-4d1f-85eb-caab98c58006 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:50:07.449925 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-120fe5c0-44e5-4d1f-85eb-caab98c58006 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a7a5a9773d84145bbf611439d025dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6983c51eda664586ba62e206acfcc2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:50:07.457416 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-120fe5c0-44e5-4d1f-85eb-caab98c58006 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] 10.222.0.42 "GET /compute/v2.1/servers/9f9f1452-525b-45a2-b131-5ccbddab15a0" status: 200 len: 1267 microversion: 2.1 time: 0.154539 Jun 06 10:50:07.457980 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 482/979] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:50:07 2022] GET /compute/v2.1/servers/9f9f1452-525b-45a2-b131-5ccbddab15a0 => generated 1267 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:50:07.644171 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [req-71ea687b-95e4-4e6b-94c6-fa60aba95330 req-c7e59662-18d9-4b22-a46b-cfab4671bf8b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f9f1452-525b-45a2-b131-5ccbddab15a0", "name": "network-vif-plugged", "status": "completed", "tag": "a5bcd46b-b585-4fa0-966c-9dcec1fda806"}]} {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 10:50:07.652515 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [req-71ea687b-95e4-4e6b-94c6-fa60aba95330 req-c7e59662-18d9-4b22-a46b-cfab4671bf8b service nova] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:50:07.652865 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [req-71ea687b-95e4-4e6b-94c6-fa60aba95330 req-c7e59662-18d9-4b22-a46b-cfab4671bf8b service nova] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:50:07.664170 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.compute.server_external_events [req-71ea687b-95e4-4e6b-94c6-fa60aba95330 req-c7e59662-18d9-4b22-a46b-cfab4671bf8b service nova] Creating event network-vif-plugged:a5bcd46b-b585-4fa0-966c-9dcec1fda806 for instance 9f9f1452-525b-45a2-b131-5ccbddab15a0 on hv-cinder-84482 Jun 06 10:50:07.669077 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [req-71ea687b-95e4-4e6b-94c6-fa60aba95330 req-c7e59662-18d9-4b22-a46b-cfab4671bf8b service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085560 Jun 06 10:50:07.669631 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 498/980] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Jun 6 10:50:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 10:50:08.474106 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-ab333be7-7f87-4779-b022-b0d06526de7e tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:50:08.474712 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-ab333be7-7f87-4779-b022-b0d06526de7e tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] [instance: 9f9f1452-525b-45a2-b131-5ccbddab15a0] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:50:08.481404 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-ab333be7-7f87-4779-b022-b0d06526de7e tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:50:08.481844 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-ab333be7-7f87-4779-b022-b0d06526de7e tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:50:08.482597 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-ab333be7-7f87-4779-b022-b0d06526de7e tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:50:08.483029 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-ab333be7-7f87-4779-b022-b0d06526de7e tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:50:08.562945 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 06 10:50:08.563112 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: Mon Jun 6 10:50:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 06 10:50:08.611944 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-ab333be7-7f87-4779-b022-b0d06526de7e tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a7a5a9773d84145bbf611439d025dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6983c51eda664586ba62e206acfcc2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:50:08.620101 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-ab333be7-7f87-4779-b022-b0d06526de7e tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] 10.222.0.42 "GET /compute/v2.1/servers/9f9f1452-525b-45a2-b131-5ccbddab15a0" status: 200 len: 1267 microversion: 2.1 time: 0.149874 Jun 06 10:50:08.620661 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 483/981] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:50:08 2022] GET /compute/v2.1/servers/9f9f1452-525b-45a2-b131-5ccbddab15a0 => generated 1267 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:50:09.637837 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-29d6abd5-bccc-4f72-8abb-b3199faf14f2 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:50:09.638457 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-29d6abd5-bccc-4f72-8abb-b3199faf14f2 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] [instance: 9f9f1452-525b-45a2-b131-5ccbddab15a0] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:50:09.644909 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-29d6abd5-bccc-4f72-8abb-b3199faf14f2 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:50:09.645844 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-29d6abd5-bccc-4f72-8abb-b3199faf14f2 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:50:09.646602 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-29d6abd5-bccc-4f72-8abb-b3199faf14f2 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:50:09.647036 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-29d6abd5-bccc-4f72-8abb-b3199faf14f2 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:50:09.780940 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-29d6abd5-bccc-4f72-8abb-b3199faf14f2 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a7a5a9773d84145bbf611439d025dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6983c51eda664586ba62e206acfcc2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:50:09.788486 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-29d6abd5-bccc-4f72-8abb-b3199faf14f2 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] 10.222.0.42 "GET /compute/v2.1/servers/9f9f1452-525b-45a2-b131-5ccbddab15a0" status: 200 len: 1453 microversion: 2.1 time: 0.155444 Jun 06 10:50:09.789038 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 499/982] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:50:09 2022] GET /compute/v2.1/servers/9f9f1452-525b-45a2-b131-5ccbddab15a0 => generated 1453 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:50:09.804461 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-9686c750-a53f-457d-803c-56622816f53b tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:50:09.805071 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-9686c750-a53f-457d-803c-56622816f53b tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] [instance: 9f9f1452-525b-45a2-b131-5ccbddab15a0] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:50:09.811469 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-9686c750-a53f-457d-803c-56622816f53b tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:50:09.811971 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-9686c750-a53f-457d-803c-56622816f53b tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:50:09.812722 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-9686c750-a53f-457d-803c-56622816f53b tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:50:09.813149 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-9686c750-a53f-457d-803c-56622816f53b tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:50:09.941312 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-9686c750-a53f-457d-803c-56622816f53b tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a7a5a9773d84145bbf611439d025dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6983c51eda664586ba62e206acfcc2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:50:09.949312 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-9686c750-a53f-457d-803c-56622816f53b tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] 10.222.0.42 "GET /compute/v2.1/servers/9f9f1452-525b-45a2-b131-5ccbddab15a0" status: 200 len: 1453 microversion: 2.1 time: 0.148916 Jun 06 10:50:09.949867 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 484/983] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:50:09 2022] GET /compute/v2.1/servers/9f9f1452-525b-45a2-b131-5ccbddab15a0 => generated 1453 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:50:11.911506 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [req-9c3518a4-5dd9-4697-ab0d-b480295495b5 req-df27d02f-880e-423a-a92a-8eabba24d748 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9f9f1452-525b-45a2-b131-5ccbddab15a0", "tag": "a5bcd46b-b585-4fa0-966c-9dcec1fda806"}]} {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 10:50:11.919225 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [req-9c3518a4-5dd9-4697-ab0d-b480295495b5 req-df27d02f-880e-423a-a92a-8eabba24d748 service nova] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:50:11.919668 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [req-9c3518a4-5dd9-4697-ab0d-b480295495b5 req-df27d02f-880e-423a-a92a-8eabba24d748 service nova] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:50:11.930410 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.compute.server_external_events [req-9c3518a4-5dd9-4697-ab0d-b480295495b5 req-df27d02f-880e-423a-a92a-8eabba24d748 service nova] Creating event network-changed:a5bcd46b-b585-4fa0-966c-9dcec1fda806 for instance 9f9f1452-525b-45a2-b131-5ccbddab15a0 on hv-cinder-84482 Jun 06 10:50:11.935375 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [req-9c3518a4-5dd9-4697-ab0d-b480295495b5 req-df27d02f-880e-423a-a92a-8eabba24d748 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.139060 Jun 06 10:50:11.936007 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 500/984] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Jun 6 10:50:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 10:50:12.362969 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 06 10:50:12.363179 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: Mon Jun 6 10:50:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 06 10:51:45.706604 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-aa65e5c4-c400-4a89-9d73-dbf56a680bd7 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-322786244", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1544406201", "security_groups": [{"name": "tempest-secgroup-smoke-2130332908"}], "block_device_mapping_v2": [{"uuid": "1c976a47-df5f-4154-bca3-eeb58e24de63", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "9c358abd-588b-47b2-9ff6-6faded31ee83"}]}} {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 10:51:45.715965 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG dbcounter [-] [129350] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=129350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 10:51:45.716649 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG dbcounter [-] [129350] Writing DB stats nova_cell1:SELECT=78,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 10:51:45.822801 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.network.neutron [None req-aa65e5c4-c400-4a89-9d73-dbf56a680bd7 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] validate_networks() for [('9c358abd-588b-47b2-9ff6-6faded31ee83', None, None, None, None, None)] {{(pid=129350) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 06 10:51:46.181706 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.virt.hardware [None req-aa65e5c4-c400-4a89-9d73-dbf56a680bd7 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Flavor limits 0:0:0 {{(pid=129350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 06 10:51:46.182073 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.virt.hardware [None req-aa65e5c4-c400-4a89-9d73-dbf56a680bd7 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Image limits 0:0:0 {{(pid=129350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 06 10:51:46.182549 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.virt.hardware [None req-aa65e5c4-c400-4a89-9d73-dbf56a680bd7 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Flavor pref 0:0:0 {{(pid=129350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 06 10:51:46.182964 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.virt.hardware [None req-aa65e5c4-c400-4a89-9d73-dbf56a680bd7 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Image pref 0:0:0 {{(pid=129350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 06 10:51:46.183378 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.virt.hardware [None req-aa65e5c4-c400-4a89-9d73-dbf56a680bd7 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 06 10:51:46.192352 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-aa65e5c4-c400-4a89-9d73-dbf56a680bd7 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:51:46.192797 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-aa65e5c4-c400-4a89-9d73-dbf56a680bd7 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:51:46.193602 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-aa65e5c4-c400-4a89-9d73-dbf56a680bd7 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:51:46.194034 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-aa65e5c4-c400-4a89-9d73-dbf56a680bd7 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:51:46.211223 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.quota [None req-aa65e5c4-c400-4a89-9d73-dbf56a680bd7 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Getting quotas for project 6983c51eda664586ba62e206acfcc2d9. Resources: {'ram', 'cores', 'instances'} {{(pid=129350) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 06 10:51:46.215660 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.quota [None req-aa65e5c4-c400-4a89-9d73-dbf56a680bd7 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Getting quotas for user 8a7a5a9773d84145bbf611439d025dd8 and project 6983c51eda664586ba62e206acfcc2d9. Resources: {'ram', 'cores', 'instances'} {{(pid=129350) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 06 10:51:46.272347 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-aa65e5c4-c400-4a89-9d73-dbf56a680bd7 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Going to run 1 instances... {{(pid=129350) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 06 10:51:46.275360 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-aa65e5c4-c400-4a89-9d73-dbf56a680bd7 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] [instance: a73cd6ba-c291-4a59-9e6c-a21c3d977dae] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='1c976a47-df5f-4154-bca3-eeb58e24de63',volume_size=None,volume_type=None)] {{(pid=129350) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 06 10:51:46.402906 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-aa65e5c4-c400-4a89-9d73-dbf56a680bd7 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.700505 Jun 06 10:51:46.403940 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 485/985] 10.222.0.42 () {60 vars in 1146 bytes} [Mon Jun 6 10:51:45 2022] POST /compute/v2.1/servers => generated 406 bytes in 702 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 06 10:51:46.412721 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG dbcounter [-] [129349] Writing DB stats nova_api:SELECT=32 {{(pid=129349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 10:51:46.413520 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG dbcounter [-] [129349] Writing DB stats nova_cell1:SELECT=56 {{(pid=129349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 10:51:46.418984 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-5f729bd5-1d03-4f5c-8e9b-cb9be0904962 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:51:46.419689 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-5f729bd5-1d03-4f5c-8e9b-cb9be0904962 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] [instance: a73cd6ba-c291-4a59-9e6c-a21c3d977dae] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:51:46.476254 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-5f729bd5-1d03-4f5c-8e9b-cb9be0904962 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a7a5a9773d84145bbf611439d025dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6983c51eda664586ba62e206acfcc2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:51:46.483005 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-5f729bd5-1d03-4f5c-8e9b-cb9be0904962 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] 10.222.0.42 "GET /compute/v2.1/servers/a73cd6ba-c291-4a59-9e6c-a21c3d977dae" status: 200 len: 1094 microversion: 2.1 time: 0.072963 Jun 06 10:51:46.483588 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 501/986] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:51:46 2022] GET /compute/v2.1/servers/a73cd6ba-c291-4a59-9e6c-a21c3d977dae => generated 1094 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:51:47.501012 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-84f9e5ff-a7a2-4509-a634-7ee896902fa4 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:51:47.501622 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-84f9e5ff-a7a2-4509-a634-7ee896902fa4 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] [instance: a73cd6ba-c291-4a59-9e6c-a21c3d977dae] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:51:47.508719 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-84f9e5ff-a7a2-4509-a634-7ee896902fa4 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:51:47.509170 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-84f9e5ff-a7a2-4509-a634-7ee896902fa4 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:51:47.509936 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-84f9e5ff-a7a2-4509-a634-7ee896902fa4 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:51:47.510361 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-84f9e5ff-a7a2-4509-a634-7ee896902fa4 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:51:47.573403 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-84f9e5ff-a7a2-4509-a634-7ee896902fa4 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a7a5a9773d84145bbf611439d025dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6983c51eda664586ba62e206acfcc2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:51:47.580914 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-84f9e5ff-a7a2-4509-a634-7ee896902fa4 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] 10.222.0.42 "GET /compute/v2.1/servers/a73cd6ba-c291-4a59-9e6c-a21c3d977dae" status: 200 len: 1210 microversion: 2.1 time: 0.084490 Jun 06 10:51:47.581468 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 486/987] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:51:47 2022] GET /compute/v2.1/servers/a73cd6ba-c291-4a59-9e6c-a21c3d977dae => generated 1210 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:51:48.598459 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-beabbb1b-b115-484c-8ab5-eb4cec9dbdf3 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:51:48.599126 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-beabbb1b-b115-484c-8ab5-eb4cec9dbdf3 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] [instance: a73cd6ba-c291-4a59-9e6c-a21c3d977dae] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:51:48.607176 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-beabbb1b-b115-484c-8ab5-eb4cec9dbdf3 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:51:48.607571 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-beabbb1b-b115-484c-8ab5-eb4cec9dbdf3 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:51:48.608378 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-beabbb1b-b115-484c-8ab5-eb4cec9dbdf3 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:51:48.608820 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-beabbb1b-b115-484c-8ab5-eb4cec9dbdf3 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:51:48.632850 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [req-fc330443-d136-4467-ae97-2caf010c0552 req-234bbcd6-5874-45eb-aace-cc493a72d1c7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a73cd6ba-c291-4a59-9e6c-a21c3d977dae", "tag": "fc015af3-034b-4303-a2ec-35cc8daad198"}]} {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 10:51:48.673070 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [req-fc330443-d136-4467-ae97-2caf010c0552 req-234bbcd6-5874-45eb-aace-cc493a72d1c7 service nova] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:51:48.674017 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [req-fc330443-d136-4467-ae97-2caf010c0552 req-234bbcd6-5874-45eb-aace-cc493a72d1c7 service nova] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:51:48.705109 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.compute.server_external_events [req-fc330443-d136-4467-ae97-2caf010c0552 req-234bbcd6-5874-45eb-aace-cc493a72d1c7 service nova] Creating event network-changed:fc015af3-034b-4303-a2ec-35cc8daad198 for instance a73cd6ba-c291-4a59-9e6c-a21c3d977dae on hv-cinder-84482 Jun 06 10:51:48.711343 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [req-fc330443-d136-4467-ae97-2caf010c0552 req-234bbcd6-5874-45eb-aace-cc493a72d1c7 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082325 Jun 06 10:51:48.713890 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 487/988] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Jun 6 10:51:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 10:51:48.756043 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-beabbb1b-b115-484c-8ab5-eb4cec9dbdf3 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a7a5a9773d84145bbf611439d025dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6983c51eda664586ba62e206acfcc2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:51:48.764540 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-beabbb1b-b115-484c-8ab5-eb4cec9dbdf3 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] 10.222.0.42 "GET /compute/v2.1/servers/a73cd6ba-c291-4a59-9e6c-a21c3d977dae" status: 200 len: 1266 microversion: 2.1 time: 0.169851 Jun 06 10:51:48.765117 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 502/989] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:51:48 2022] GET /compute/v2.1/servers/a73cd6ba-c291-4a59-9e6c-a21c3d977dae => generated 1266 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:51:49.782061 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-20d3ac7b-de73-4f69-9b00-fe6f3eefdebe tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:51:49.782803 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-20d3ac7b-de73-4f69-9b00-fe6f3eefdebe tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] [instance: a73cd6ba-c291-4a59-9e6c-a21c3d977dae] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:51:49.791104 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-20d3ac7b-de73-4f69-9b00-fe6f3eefdebe tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:51:49.791345 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-20d3ac7b-de73-4f69-9b00-fe6f3eefdebe tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:51:49.792166 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-20d3ac7b-de73-4f69-9b00-fe6f3eefdebe tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:51:49.792860 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-20d3ac7b-de73-4f69-9b00-fe6f3eefdebe tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:51:49.926021 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-20d3ac7b-de73-4f69-9b00-fe6f3eefdebe tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a7a5a9773d84145bbf611439d025dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6983c51eda664586ba62e206acfcc2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:51:49.934241 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-20d3ac7b-de73-4f69-9b00-fe6f3eefdebe tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] 10.222.0.42 "GET /compute/v2.1/servers/a73cd6ba-c291-4a59-9e6c-a21c3d977dae" status: 200 len: 1266 microversion: 2.1 time: 0.156341 Jun 06 10:51:49.934737 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 488/990] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:51:49 2022] GET /compute/v2.1/servers/a73cd6ba-c291-4a59-9e6c-a21c3d977dae => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:51:50.951116 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-f179ca5f-7dda-4285-90e8-384c4badb833 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:51:50.951739 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-f179ca5f-7dda-4285-90e8-384c4badb833 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] [instance: a73cd6ba-c291-4a59-9e6c-a21c3d977dae] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:51:50.958217 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-f179ca5f-7dda-4285-90e8-384c4badb833 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:51:50.958661 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-f179ca5f-7dda-4285-90e8-384c4badb833 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:51:50.959422 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-f179ca5f-7dda-4285-90e8-384c4badb833 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:51:50.959886 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-f179ca5f-7dda-4285-90e8-384c4badb833 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:51:51.091814 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-f179ca5f-7dda-4285-90e8-384c4badb833 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a7a5a9773d84145bbf611439d025dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6983c51eda664586ba62e206acfcc2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:51:51.099111 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-f179ca5f-7dda-4285-90e8-384c4badb833 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] 10.222.0.42 "GET /compute/v2.1/servers/a73cd6ba-c291-4a59-9e6c-a21c3d977dae" status: 200 len: 1266 microversion: 2.1 time: 0.152004 Jun 06 10:51:51.099659 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 503/991] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:51:50 2022] GET /compute/v2.1/servers/a73cd6ba-c291-4a59-9e6c-a21c3d977dae => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:51:52.115675 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-d64731aa-b263-4752-ac4a-ee9e4bc6ad56 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:51:52.116332 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-d64731aa-b263-4752-ac4a-ee9e4bc6ad56 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] [instance: a73cd6ba-c291-4a59-9e6c-a21c3d977dae] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:51:52.123013 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-d64731aa-b263-4752-ac4a-ee9e4bc6ad56 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:51:52.123459 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-d64731aa-b263-4752-ac4a-ee9e4bc6ad56 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:51:52.124278 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-d64731aa-b263-4752-ac4a-ee9e4bc6ad56 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:51:52.124711 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-d64731aa-b263-4752-ac4a-ee9e4bc6ad56 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:51:52.252859 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-d64731aa-b263-4752-ac4a-ee9e4bc6ad56 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a7a5a9773d84145bbf611439d025dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6983c51eda664586ba62e206acfcc2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:51:52.260183 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-d64731aa-b263-4752-ac4a-ee9e4bc6ad56 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] 10.222.0.42 "GET /compute/v2.1/servers/a73cd6ba-c291-4a59-9e6c-a21c3d977dae" status: 200 len: 1266 microversion: 2.1 time: 0.148360 Jun 06 10:51:52.260741 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 489/992] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:51:52 2022] GET /compute/v2.1/servers/a73cd6ba-c291-4a59-9e6c-a21c3d977dae => generated 1266 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:51:53.277907 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-88d5b6fb-25ae-4c4c-adef-e4ac5824fa8c tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:51:53.278519 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-88d5b6fb-25ae-4c4c-adef-e4ac5824fa8c tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] [instance: a73cd6ba-c291-4a59-9e6c-a21c3d977dae] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:51:53.285171 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-88d5b6fb-25ae-4c4c-adef-e4ac5824fa8c tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:51:53.285622 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-88d5b6fb-25ae-4c4c-adef-e4ac5824fa8c tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:51:53.286394 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-88d5b6fb-25ae-4c4c-adef-e4ac5824fa8c tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:51:53.286833 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-88d5b6fb-25ae-4c4c-adef-e4ac5824fa8c tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:51:53.419109 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-88d5b6fb-25ae-4c4c-adef-e4ac5824fa8c tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a7a5a9773d84145bbf611439d025dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6983c51eda664586ba62e206acfcc2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:51:53.426506 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-88d5b6fb-25ae-4c4c-adef-e4ac5824fa8c tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] 10.222.0.42 "GET /compute/v2.1/servers/a73cd6ba-c291-4a59-9e6c-a21c3d977dae" status: 200 len: 1266 microversion: 2.1 time: 0.153465 Jun 06 10:51:53.427056 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 504/993] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:51:53 2022] GET /compute/v2.1/servers/a73cd6ba-c291-4a59-9e6c-a21c3d977dae => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:51:54.442951 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-02ff8e1c-12b6-41da-979d-f73340675acf tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:51:54.443569 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-02ff8e1c-12b6-41da-979d-f73340675acf tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] [instance: a73cd6ba-c291-4a59-9e6c-a21c3d977dae] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:51:54.451276 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-02ff8e1c-12b6-41da-979d-f73340675acf tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:51:54.451723 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-02ff8e1c-12b6-41da-979d-f73340675acf tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:51:54.452605 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-02ff8e1c-12b6-41da-979d-f73340675acf tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:51:54.453042 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-02ff8e1c-12b6-41da-979d-f73340675acf tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:51:54.580311 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-02ff8e1c-12b6-41da-979d-f73340675acf tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a7a5a9773d84145bbf611439d025dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6983c51eda664586ba62e206acfcc2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:51:54.588221 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-02ff8e1c-12b6-41da-979d-f73340675acf tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] 10.222.0.42 "GET /compute/v2.1/servers/a73cd6ba-c291-4a59-9e6c-a21c3d977dae" status: 200 len: 1266 microversion: 2.1 time: 0.149147 Jun 06 10:51:54.588778 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 490/994] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:51:54 2022] GET /compute/v2.1/servers/a73cd6ba-c291-4a59-9e6c-a21c3d977dae => generated 1266 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:51:55.605537 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-7c67aa7f-8c9c-42af-9701-b408ec776278 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:51:55.606142 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-7c67aa7f-8c9c-42af-9701-b408ec776278 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] [instance: a73cd6ba-c291-4a59-9e6c-a21c3d977dae] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:51:55.612640 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-7c67aa7f-8c9c-42af-9701-b408ec776278 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:51:55.613083 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-7c67aa7f-8c9c-42af-9701-b408ec776278 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:51:55.613898 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-7c67aa7f-8c9c-42af-9701-b408ec776278 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:51:55.614329 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-7c67aa7f-8c9c-42af-9701-b408ec776278 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:51:55.749839 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-7c67aa7f-8c9c-42af-9701-b408ec776278 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a7a5a9773d84145bbf611439d025dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6983c51eda664586ba62e206acfcc2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:51:55.757269 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-7c67aa7f-8c9c-42af-9701-b408ec776278 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] 10.222.0.42 "GET /compute/v2.1/servers/a73cd6ba-c291-4a59-9e6c-a21c3d977dae" status: 200 len: 1266 microversion: 2.1 time: 0.156323 Jun 06 10:51:55.757822 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 505/995] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:51:55 2022] GET /compute/v2.1/servers/a73cd6ba-c291-4a59-9e6c-a21c3d977dae => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 10:51:56.776202 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-8409486e-3bb6-47bb-b90b-18c57a73f389 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:51:56.776850 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-8409486e-3bb6-47bb-b90b-18c57a73f389 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] [instance: a73cd6ba-c291-4a59-9e6c-a21c3d977dae] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:51:56.780111 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG dbcounter [-] [129350] Writing DB stats nova_cell0:SELECT=2 {{(pid=129350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 10:51:56.781159 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG dbcounter [-] [129350] Writing DB stats nova_cell0:SELECT=6 {{(pid=129350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 10:51:56.788277 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-8409486e-3bb6-47bb-b90b-18c57a73f389 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:51:56.788723 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-8409486e-3bb6-47bb-b90b-18c57a73f389 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:51:56.789506 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-8409486e-3bb6-47bb-b90b-18c57a73f389 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:51:56.790576 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-8409486e-3bb6-47bb-b90b-18c57a73f389 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:51:56.923529 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-8409486e-3bb6-47bb-b90b-18c57a73f389 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a7a5a9773d84145bbf611439d025dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6983c51eda664586ba62e206acfcc2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:51:56.931186 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-8409486e-3bb6-47bb-b90b-18c57a73f389 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] 10.222.0.42 "GET /compute/v2.1/servers/a73cd6ba-c291-4a59-9e6c-a21c3d977dae" status: 200 len: 1266 microversion: 2.1 time: 0.160858 Jun 06 10:51:56.931679 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 491/996] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:51:56 2022] GET /compute/v2.1/servers/a73cd6ba-c291-4a59-9e6c-a21c3d977dae => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:51:57.948823 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-32569288-16e6-4bb5-9514-92b21d093d86 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:51:57.949532 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-32569288-16e6-4bb5-9514-92b21d093d86 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] [instance: a73cd6ba-c291-4a59-9e6c-a21c3d977dae] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:51:57.951435 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG dbcounter [-] [129349] Writing DB stats nova_cell0:SELECT=2 {{(pid=129349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 10:51:57.957168 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-32569288-16e6-4bb5-9514-92b21d093d86 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:51:57.957782 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-32569288-16e6-4bb5-9514-92b21d093d86 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:51:57.958558 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-32569288-16e6-4bb5-9514-92b21d093d86 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:51:57.958994 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-32569288-16e6-4bb5-9514-92b21d093d86 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:51:58.091551 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-32569288-16e6-4bb5-9514-92b21d093d86 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a7a5a9773d84145bbf611439d025dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6983c51eda664586ba62e206acfcc2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:51:58.099009 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-32569288-16e6-4bb5-9514-92b21d093d86 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] 10.222.0.42 "GET /compute/v2.1/servers/a73cd6ba-c291-4a59-9e6c-a21c3d977dae" status: 200 len: 1266 microversion: 2.1 time: 0.154187 Jun 06 10:51:58.099675 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 506/997] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:51:57 2022] GET /compute/v2.1/servers/a73cd6ba-c291-4a59-9e6c-a21c3d977dae => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:51:59.116502 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-a1a99c63-0628-4d55-96f2-28744f4247db tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:51:59.117109 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-a1a99c63-0628-4d55-96f2-28744f4247db tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] [instance: a73cd6ba-c291-4a59-9e6c-a21c3d977dae] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:51:59.124531 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-a1a99c63-0628-4d55-96f2-28744f4247db tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:51:59.124975 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-a1a99c63-0628-4d55-96f2-28744f4247db tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:51:59.125733 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-a1a99c63-0628-4d55-96f2-28744f4247db tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:51:59.126165 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-a1a99c63-0628-4d55-96f2-28744f4247db tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:51:59.271935 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-a1a99c63-0628-4d55-96f2-28744f4247db tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a7a5a9773d84145bbf611439d025dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6983c51eda664586ba62e206acfcc2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:51:59.279383 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-a1a99c63-0628-4d55-96f2-28744f4247db tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] 10.222.0.42 "GET /compute/v2.1/servers/a73cd6ba-c291-4a59-9e6c-a21c3d977dae" status: 200 len: 1266 microversion: 2.1 time: 0.166709 Jun 06 10:51:59.279971 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 492/998] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:51:59 2022] GET /compute/v2.1/servers/a73cd6ba-c291-4a59-9e6c-a21c3d977dae => generated 1266 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:52:00.053271 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [req-e98663ea-dedc-4d6b-b59e-e987f07978a5 req-74944e55-ac3c-4787-b07e-b25d4244bd18 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a73cd6ba-c291-4a59-9e6c-a21c3d977dae", "name": "network-vif-plugged", "status": "completed", "tag": "fc015af3-034b-4303-a2ec-35cc8daad198"}]} {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 10:52:00.063504 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [req-e98663ea-dedc-4d6b-b59e-e987f07978a5 req-74944e55-ac3c-4787-b07e-b25d4244bd18 service nova] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:52:00.064056 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [req-e98663ea-dedc-4d6b-b59e-e987f07978a5 req-74944e55-ac3c-4787-b07e-b25d4244bd18 service nova] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:52:00.076084 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.compute.server_external_events [req-e98663ea-dedc-4d6b-b59e-e987f07978a5 req-74944e55-ac3c-4787-b07e-b25d4244bd18 service nova] Creating event network-vif-plugged:fc015af3-034b-4303-a2ec-35cc8daad198 for instance a73cd6ba-c291-4a59-9e6c-a21c3d977dae on hv-cinder-84482 Jun 06 10:52:00.081269 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [req-e98663ea-dedc-4d6b-b59e-e987f07978a5 req-74944e55-ac3c-4787-b07e-b25d4244bd18 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031785 Jun 06 10:52:00.081863 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 507/999] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Jun 6 10:52:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 10:52:00.296377 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-504d5446-383f-4bbd-9b4d-6b25242fffd7 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:52:00.297066 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-504d5446-383f-4bbd-9b4d-6b25242fffd7 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] [instance: a73cd6ba-c291-4a59-9e6c-a21c3d977dae] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:52:00.303538 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-504d5446-383f-4bbd-9b4d-6b25242fffd7 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:52:00.304038 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-504d5446-383f-4bbd-9b4d-6b25242fffd7 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:52:00.304812 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-504d5446-383f-4bbd-9b4d-6b25242fffd7 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:52:00.305835 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-504d5446-383f-4bbd-9b4d-6b25242fffd7 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:52:00.438842 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-504d5446-383f-4bbd-9b4d-6b25242fffd7 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a7a5a9773d84145bbf611439d025dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6983c51eda664586ba62e206acfcc2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:52:00.447053 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-504d5446-383f-4bbd-9b4d-6b25242fffd7 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] 10.222.0.42 "GET /compute/v2.1/servers/a73cd6ba-c291-4a59-9e6c-a21c3d977dae" status: 200 len: 1266 microversion: 2.1 time: 0.154620 Jun 06 10:52:00.447655 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 493/1000] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:52:00 2022] GET /compute/v2.1/servers/a73cd6ba-c291-4a59-9e6c-a21c3d977dae => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:52:01.464628 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-dd501a13-db01-466d-8b63-c3918fcb6e31 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:52:01.465389 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-dd501a13-db01-466d-8b63-c3918fcb6e31 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] [instance: a73cd6ba-c291-4a59-9e6c-a21c3d977dae] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:52:01.471541 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-dd501a13-db01-466d-8b63-c3918fcb6e31 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:52:01.472029 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-dd501a13-db01-466d-8b63-c3918fcb6e31 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:52:01.472794 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-dd501a13-db01-466d-8b63-c3918fcb6e31 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:52:01.473229 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-dd501a13-db01-466d-8b63-c3918fcb6e31 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:52:01.603345 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-dd501a13-db01-466d-8b63-c3918fcb6e31 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a7a5a9773d84145bbf611439d025dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6983c51eda664586ba62e206acfcc2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:52:01.611710 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-dd501a13-db01-466d-8b63-c3918fcb6e31 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] 10.222.0.42 "GET /compute/v2.1/servers/a73cd6ba-c291-4a59-9e6c-a21c3d977dae" status: 200 len: 1453 microversion: 2.1 time: 0.152486 Jun 06 10:52:01.612383 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 508/1001] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:52:01 2022] GET /compute/v2.1/servers/a73cd6ba-c291-4a59-9e6c-a21c3d977dae => generated 1453 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:52:01.628286 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-c7aa536e-76c3-4b42-a6d6-a33e38dad072 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:52:01.628903 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-c7aa536e-76c3-4b42-a6d6-a33e38dad072 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] [instance: a73cd6ba-c291-4a59-9e6c-a21c3d977dae] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:52:01.636076 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-c7aa536e-76c3-4b42-a6d6-a33e38dad072 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:52:01.636532 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-c7aa536e-76c3-4b42-a6d6-a33e38dad072 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:52:01.637362 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-c7aa536e-76c3-4b42-a6d6-a33e38dad072 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:52:01.637727 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-c7aa536e-76c3-4b42-a6d6-a33e38dad072 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:52:01.769270 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-c7aa536e-76c3-4b42-a6d6-a33e38dad072 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a7a5a9773d84145bbf611439d025dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6983c51eda664586ba62e206acfcc2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:52:01.777136 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-c7aa536e-76c3-4b42-a6d6-a33e38dad072 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] 10.222.0.42 "GET /compute/v2.1/servers/a73cd6ba-c291-4a59-9e6c-a21c3d977dae" status: 200 len: 1453 microversion: 2.1 time: 0.152729 Jun 06 10:52:01.777696 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 494/1002] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:52:01 2022] GET /compute/v2.1/servers/a73cd6ba-c291-4a59-9e6c-a21c3d977dae => generated 1453 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:52:03.625564 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [req-df331a5a-5c5f-4707-92c1-125f66f9281b req-781e8aef-8045-41ab-bdeb-61034adc186f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a73cd6ba-c291-4a59-9e6c-a21c3d977dae", "tag": "fc015af3-034b-4303-a2ec-35cc8daad198"}]} {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 10:52:03.635267 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [req-df331a5a-5c5f-4707-92c1-125f66f9281b req-781e8aef-8045-41ab-bdeb-61034adc186f service nova] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:52:03.635720 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [req-df331a5a-5c5f-4707-92c1-125f66f9281b req-781e8aef-8045-41ab-bdeb-61034adc186f service nova] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:52:03.646737 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.compute.server_external_events [req-df331a5a-5c5f-4707-92c1-125f66f9281b req-781e8aef-8045-41ab-bdeb-61034adc186f service nova] Creating event network-changed:fc015af3-034b-4303-a2ec-35cc8daad198 for instance a73cd6ba-c291-4a59-9e6c-a21c3d977dae on hv-cinder-84482 Jun 06 10:52:03.653330 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [req-df331a5a-5c5f-4707-92c1-125f66f9281b req-781e8aef-8045-41ab-bdeb-61034adc186f service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031198 Jun 06 10:52:03.653995 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 509/1003] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Jun 6 10:52:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 10:53:14.717945 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 06 10:53:14.718545 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: Mon Jun 6 10:53:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 06 10:53:28.572478 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 06 10:53:28.573014 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: Mon Jun 6 10:53:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 06 10:53:31.602452 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG dbcounter [-] [129350] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=129350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 10:53:31.603560 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG dbcounter [-] [129350] Writing DB stats nova_cell1:SELECT=52 {{(pid=129350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 10:53:31.607807 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-ae280404-eac6-4e12-9e2d-444505e8573b tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:53:31.608218 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [req-eafdd7ec-0a7c-4b95-b3ab-d7cf61bfbbb8 req-91352e7f-9581-40f1-be6d-fa997c84898a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a73cd6ba-c291-4a59-9e6c-a21c3d977dae", "tag": "fc015af3-034b-4303-a2ec-35cc8daad198"}]} {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 10:53:31.608654 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-ae280404-eac6-4e12-9e2d-444505e8573b tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] [instance: a73cd6ba-c291-4a59-9e6c-a21c3d977dae] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:53:31.612814 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG dbcounter [-] [129349] Writing DB stats nova_api:SELECT=20 {{(pid=129349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 10:53:31.613441 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG dbcounter [-] [129349] Writing DB stats nova_cell1:SELECT=40 {{(pid=129349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 10:53:31.615406 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-ae280404-eac6-4e12-9e2d-444505e8573b tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:53:31.615746 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-ae280404-eac6-4e12-9e2d-444505e8573b tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:53:31.616718 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-ae280404-eac6-4e12-9e2d-444505e8573b tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:53:31.617162 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-ae280404-eac6-4e12-9e2d-444505e8573b tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:53:31.620004 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [req-eafdd7ec-0a7c-4b95-b3ab-d7cf61bfbbb8 req-91352e7f-9581-40f1-be6d-fa997c84898a service nova] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:53:31.620449 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [req-eafdd7ec-0a7c-4b95-b3ab-d7cf61bfbbb8 req-91352e7f-9581-40f1-be6d-fa997c84898a service nova] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:53:31.633313 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.compute.server_external_events [req-eafdd7ec-0a7c-4b95-b3ab-d7cf61bfbbb8 req-91352e7f-9581-40f1-be6d-fa997c84898a service nova] Creating event network-changed:fc015af3-034b-4303-a2ec-35cc8daad198 for instance a73cd6ba-c291-4a59-9e6c-a21c3d977dae on hv-cinder-84482 Jun 06 10:53:31.639341 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [req-eafdd7ec-0a7c-4b95-b3ab-d7cf61bfbbb8 req-91352e7f-9581-40f1-be6d-fa997c84898a service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036689 Jun 06 10:53:31.640511 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 510/1004] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Jun 6 10:53:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 10:53:31.644052 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-ae280404-eac6-4e12-9e2d-444505e8573b tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] [instance: a73cd6ba-c291-4a59-9e6c-a21c3d977dae] Going to try to terminate instance {{(pid=129350) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 06 10:53:31.733220 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-ae280404-eac6-4e12-9e2d-444505e8573b tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] 10.222.0.42 "DELETE /compute/v2.1/servers/a73cd6ba-c291-4a59-9e6c-a21c3d977dae" status: 204 len: 0 microversion: 2.1 time: 0.132431 Jun 06 10:53:31.734032 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 495/1005] 10.222.0.42 () {58 vars in 1238 bytes} [Mon Jun 6 10:53:31 2022] DELETE /compute/v2.1/servers/a73cd6ba-c291-4a59-9e6c-a21c3d977dae => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 06 10:53:31.742808 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-278996c7-9052-4992-a32a-de077ec06da6 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:53:31.744097 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-278996c7-9052-4992-a32a-de077ec06da6 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] [instance: a73cd6ba-c291-4a59-9e6c-a21c3d977dae] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:53:31.750544 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-278996c7-9052-4992-a32a-de077ec06da6 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:53:31.751096 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-278996c7-9052-4992-a32a-de077ec06da6 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:53:31.751890 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-278996c7-9052-4992-a32a-de077ec06da6 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:53:31.752320 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-278996c7-9052-4992-a32a-de077ec06da6 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:53:31.886917 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-278996c7-9052-4992-a32a-de077ec06da6 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a7a5a9773d84145bbf611439d025dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6983c51eda664586ba62e206acfcc2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:53:31.894621 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-278996c7-9052-4992-a32a-de077ec06da6 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] 10.222.0.42 "GET /compute/v2.1/servers/a73cd6ba-c291-4a59-9e6c-a21c3d977dae" status: 200 len: 1578 microversion: 2.1 time: 0.155983 Jun 06 10:53:31.895189 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 511/1006] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:53:31 2022] GET /compute/v2.1/servers/a73cd6ba-c291-4a59-9e6c-a21c3d977dae => generated 1578 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:53:32.372994 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 06 10:53:32.373165 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: Mon Jun 6 10:53:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 06 10:53:32.913088 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-b4d0076e-7804-4c3f-a541-b0c0322817ca tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:53:32.913704 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-b4d0076e-7804-4c3f-a541-b0c0322817ca tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] [instance: a73cd6ba-c291-4a59-9e6c-a21c3d977dae] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:53:32.920814 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-b4d0076e-7804-4c3f-a541-b0c0322817ca tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:53:32.921260 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-b4d0076e-7804-4c3f-a541-b0c0322817ca tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:53:32.922029 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-b4d0076e-7804-4c3f-a541-b0c0322817ca tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:53:32.922463 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-b4d0076e-7804-4c3f-a541-b0c0322817ca tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:53:33.056405 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-b4d0076e-7804-4c3f-a541-b0c0322817ca tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a7a5a9773d84145bbf611439d025dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6983c51eda664586ba62e206acfcc2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:53:33.063742 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-b4d0076e-7804-4c3f-a541-b0c0322817ca tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] 10.222.0.42 "GET /compute/v2.1/servers/a73cd6ba-c291-4a59-9e6c-a21c3d977dae" status: 200 len: 1578 microversion: 2.1 time: 0.155021 Jun 06 10:53:33.064320 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 496/1007] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:53:32 2022] GET /compute/v2.1/servers/a73cd6ba-c291-4a59-9e6c-a21c3d977dae => generated 1578 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:53:33.633287 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [req-84310e23-4901-4301-a430-78ffc8458e97 req-4d481464-66bc-417d-a520-1cab10087688 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a73cd6ba-c291-4a59-9e6c-a21c3d977dae", "name": "network-vif-deleted", "tag": "fc015af3-034b-4303-a2ec-35cc8daad198"}]} {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 10:53:33.643431 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [req-84310e23-4901-4301-a430-78ffc8458e97 req-4d481464-66bc-417d-a520-1cab10087688 service nova] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:53:33.643960 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [req-84310e23-4901-4301-a430-78ffc8458e97 req-4d481464-66bc-417d-a520-1cab10087688 service nova] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:53:33.655585 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.compute.server_external_events [req-84310e23-4901-4301-a430-78ffc8458e97 req-4d481464-66bc-417d-a520-1cab10087688 service nova] Creating event network-vif-deleted:fc015af3-034b-4303-a2ec-35cc8daad198 for instance a73cd6ba-c291-4a59-9e6c-a21c3d977dae on hv-cinder-84482 Jun 06 10:53:33.660419 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [req-84310e23-4901-4301-a430-78ffc8458e97 req-4d481464-66bc-417d-a520-1cab10087688 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030847 Jun 06 10:53:33.661002 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 512/1008] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Jun 6 10:53:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 10:53:34.081060 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-c54136cc-f30d-4ed1-8037-375577e2e006 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:53:34.081583 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-c54136cc-f30d-4ed1-8037-375577e2e006 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] [instance: a73cd6ba-c291-4a59-9e6c-a21c3d977dae] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:53:34.088826 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-c54136cc-f30d-4ed1-8037-375577e2e006 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:53:34.089271 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-c54136cc-f30d-4ed1-8037-375577e2e006 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:53:34.090027 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-c54136cc-f30d-4ed1-8037-375577e2e006 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:53:34.090456 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-c54136cc-f30d-4ed1-8037-375577e2e006 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:53:34.121514 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-c54136cc-f30d-4ed1-8037-375577e2e006 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:53:34.121956 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-c54136cc-f30d-4ed1-8037-375577e2e006 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:53:34.122398 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.objects.instance [None req-c54136cc-f30d-4ed1-8037-375577e2e006 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Lazy-loading 'fault' on Instance uuid a73cd6ba-c291-4a59-9e6c-a21c3d977dae {{(pid=129350) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 06 10:53:34.166083 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-c54136cc-f30d-4ed1-8037-375577e2e006 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a7a5a9773d84145bbf611439d025dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6983c51eda664586ba62e206acfcc2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:53:34.173960 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-c54136cc-f30d-4ed1-8037-375577e2e006 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] 10.222.0.42 "GET /compute/v2.1/servers/a73cd6ba-c291-4a59-9e6c-a21c3d977dae" status: 200 len: 1230 microversion: 2.1 time: 0.096803 Jun 06 10:53:34.174524 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 497/1009] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:53:34 2022] GET /compute/v2.1/servers/a73cd6ba-c291-4a59-9e6c-a21c3d977dae => generated 1230 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:53:35.193605 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-c7ce056e-1ce5-404c-9349-cf1f5769c3b0 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:53:35.194303 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-c7ce056e-1ce5-404c-9349-cf1f5769c3b0 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] [instance: a73cd6ba-c291-4a59-9e6c-a21c3d977dae] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:53:35.200734 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-c7ce056e-1ce5-404c-9349-cf1f5769c3b0 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:53:35.201178 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-c7ce056e-1ce5-404c-9349-cf1f5769c3b0 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:53:35.201946 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-c7ce056e-1ce5-404c-9349-cf1f5769c3b0 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:53:35.202379 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-c7ce056e-1ce5-404c-9349-cf1f5769c3b0 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:53:35.215392 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.wsgi [None req-c7ce056e-1ce5-404c-9349-cf1f5769c3b0 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] HTTP exception thrown: Instance a73cd6ba-c291-4a59-9e6c-a21c3d977dae could not be found. Jun 06 10:53:35.216932 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-c7ce056e-1ce5-404c-9349-cf1f5769c3b0 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Request method failure captured: Jun 06 10:53:35.216932 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: request: GET /compute/v2.1/servers/a73cd6ba-c291-4a59-9e6c-a21c3d977dae HTTP/1.1 Jun 06 10:53:35.216932 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: Accept: application/json Jun 06 10:53:35.216932 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: Accept-Encoding: identity Jun 06 10:53:35.216932 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: Connection: close Jun 06 10:53:35.216932 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: Content-Length: 0 Jun 06 10:53:35.216932 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: Content-Type: application/json Jun 06 10:53:35.216932 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: Host: 10.222.0.42 Jun 06 10:53:35.216932 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: Openstack-System-Scope: None Jun 06 10:53:35.216932 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: User-Agent: python-urllib3/1.26.9 Jun 06 10:53:35.216932 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Auth-Token: gAAAAABindskOhnFjz92ngoBqEtwV4ZYzw5HwXxT8-fIYoGAXWuY7zBj8RG-thsHVQoTt29dfAjOQHYDE1c8IyyByGVfd2r2g4NhSuRYD6Lz3mVXOff0jPHEwgaN2hAEumoRzE3M76gdLEwLV3xwbgKtkPLU0AEmXGPXp2fXxRNAsDM_YbutL-s Jun 06 10:53:35.216932 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Domain-Id: None Jun 06 10:53:35.216932 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Domain-Name: None Jun 06 10:53:35.216932 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Identity-Status: Confirmed Jun 06 10:53:35.216932 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Is-Admin-Project: True Jun 06 10:53:35.216932 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Project-Domain-Id: default Jun 06 10:53:35.216932 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Project-Domain-Name: Default Jun 06 10:53:35.216932 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Project-Id: 6983c51eda664586ba62e206acfcc2d9 Jun 06 10:53:35.216932 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Project-Name: tempest-TestVolumeBootPattern-1591397316 Jun 06 10:53:35.216932 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Role: member,reader Jun 06 10:53:35.216932 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Roles: member,reader Jun 06 10:53:35.218634 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/6983c51eda664586ba62e206acfcc2d9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/6983c51eda664586ba62e206acfcc2d9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/6983c51eda664586ba62e206acfcc2d9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_6983c51eda664586ba62e206acfcc2d9", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Jun 06 10:53:35.218634 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Tenant: tempest-TestVolumeBootPattern-1591397316 Jun 06 10:53:35.218634 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Tenant-Id: 6983c51eda664586ba62e206acfcc2d9 Jun 06 10:53:35.218634 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Tenant-Name: tempest-TestVolumeBootPattern-1591397316 Jun 06 10:53:35.218634 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-User: tempest-TestVolumeBootPattern-1591397316-project Jun 06 10:53:35.218634 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-User-Domain-Id: default Jun 06 10:53:35.218634 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-User-Domain-Name: Default Jun 06 10:53:35.218634 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-User-Id: 8a7a5a9773d84145bbf611439d025dd8 Jun 06 10:53:35.218634 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-User-Name: tempest-TestVolumeBootPattern-1591397316-project Jun 06 10:53:35.218634 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: method: > Jun 06 10:53:35.218634 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: exception: Instance a73cd6ba-c291-4a59-9e6c-a21c3d977dae could not be found. Jun 06 10:53:35.218634 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: action_args: {'id': 'a73cd6ba-c291-4a59-9e6c-a21c3d977dae'} Jun 06 10:53:35.219583 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 10:53:35.219583 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 10:53:35.219583 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 06 10:53:35.219583 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 06 10:53:35.219583 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 06 10:53:35.219583 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 06 10:53:35.219583 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 06 10:53:35.219583 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 06 10:53:35.219583 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 06 10:53:35.219583 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 06 10:53:35.219583 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a73cd6ba-c291-4a59-9e6c-a21c3d977dae could not be found. Jun 06 10:53:35.219583 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Jun 06 10:53:35.219583 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 10:53:35.219583 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Jun 06 10:53:35.219583 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 10:53:35.219583 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 10:53:35.219583 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 10:53:35.219583 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 10:53:35.219583 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 10:53:35.219583 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 10:53:35.221344 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 10:53:35.221344 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 06 10:53:35.221344 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 06 10:53:35.221344 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 06 10:53:35.221344 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 06 10:53:35.221344 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 06 10:53:35.221344 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 06 10:53:35.221344 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a73cd6ba-c291-4a59-9e6c-a21c3d977dae could not be found. Jun 06 10:53:35.221344 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Jun 06 10:53:35.221344 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 10:53:35.221344 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Jun 06 10:53:35.221344 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 10:53:35.221344 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 10:53:35.221344 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 10:53:35.221344 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 10:53:35.221344 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 10:53:35.221344 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a73cd6ba-c291-4a59-9e6c-a21c3d977dae could not be found. Jun 06 10:53:35.221344 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Jun 06 10:53:35.222736 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-c7ce056e-1ce5-404c-9349-cf1f5769c3b0 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Returning 404 to user: Instance a73cd6ba-c291-4a59-9e6c-a21c3d977dae could not be found. {{(pid=129349) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 10:53:35.222736 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-c7ce056e-1ce5-404c-9349-cf1f5769c3b0 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] 10.222.0.42 "GET /compute/v2.1/servers/a73cd6ba-c291-4a59-9e6c-a21c3d977dae" status: 404 len: 111 microversion: 2.1 time: 0.029458 Jun 06 10:53:35.222736 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 513/1010] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:53:35 2022] GET /compute/v2.1/servers/a73cd6ba-c291-4a59-9e6c-a21c3d977dae => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 06 10:53:38.262665 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-d84910a2-8ab5-4e9d-961f-119eeda36276 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:53:38.263294 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-d84910a2-8ab5-4e9d-961f-119eeda36276 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] [instance: 9f9f1452-525b-45a2-b131-5ccbddab15a0] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:53:38.264806 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [req-bdcaaea6-78eb-405f-82f6-c8680cc4583b req-46d91244-6a54-45e0-9406-b52fb2369bb0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9f9f1452-525b-45a2-b131-5ccbddab15a0", "tag": "a5bcd46b-b585-4fa0-966c-9dcec1fda806"}]} {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 10:53:38.270082 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-d84910a2-8ab5-4e9d-961f-119eeda36276 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:53:38.270526 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-d84910a2-8ab5-4e9d-961f-119eeda36276 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:53:38.271285 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-d84910a2-8ab5-4e9d-961f-119eeda36276 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:53:38.272288 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-d84910a2-8ab5-4e9d-961f-119eeda36276 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:53:38.274132 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [req-bdcaaea6-78eb-405f-82f6-c8680cc4583b req-46d91244-6a54-45e0-9406-b52fb2369bb0 service nova] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:53:38.274568 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [req-bdcaaea6-78eb-405f-82f6-c8680cc4583b req-46d91244-6a54-45e0-9406-b52fb2369bb0 service nova] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:53:38.286091 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.compute.server_external_events [req-bdcaaea6-78eb-405f-82f6-c8680cc4583b req-46d91244-6a54-45e0-9406-b52fb2369bb0 service nova] Creating event network-changed:a5bcd46b-b585-4fa0-966c-9dcec1fda806 for instance 9f9f1452-525b-45a2-b131-5ccbddab15a0 on hv-cinder-84482 Jun 06 10:53:38.291563 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [req-bdcaaea6-78eb-405f-82f6-c8680cc4583b req-46d91244-6a54-45e0-9406-b52fb2369bb0 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030467 Jun 06 10:53:38.292393 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 514/1011] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Jun 6 10:53:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 10:53:38.301850 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-d84910a2-8ab5-4e9d-961f-119eeda36276 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] [instance: 9f9f1452-525b-45a2-b131-5ccbddab15a0] Going to try to terminate instance {{(pid=129350) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 06 10:53:38.396230 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-d84910a2-8ab5-4e9d-961f-119eeda36276 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] 10.222.0.42 "DELETE /compute/v2.1/servers/9f9f1452-525b-45a2-b131-5ccbddab15a0" status: 204 len: 0 microversion: 2.1 time: 0.137299 Jun 06 10:53:38.398055 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 498/1012] 10.222.0.42 () {58 vars in 1238 bytes} [Mon Jun 6 10:53:38 2022] DELETE /compute/v2.1/servers/9f9f1452-525b-45a2-b131-5ccbddab15a0 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 06 10:53:38.406889 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-bb3f2929-5fc1-4eac-a781-11f8724be9b5 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:53:38.407672 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-bb3f2929-5fc1-4eac-a781-11f8724be9b5 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] [instance: 9f9f1452-525b-45a2-b131-5ccbddab15a0] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:53:38.414196 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-bb3f2929-5fc1-4eac-a781-11f8724be9b5 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:53:38.414895 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-bb3f2929-5fc1-4eac-a781-11f8724be9b5 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:53:38.416237 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-bb3f2929-5fc1-4eac-a781-11f8724be9b5 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:53:38.416865 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-bb3f2929-5fc1-4eac-a781-11f8724be9b5 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:53:38.569932 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.policy [None req-bb3f2929-5fc1-4eac-a781-11f8724be9b5 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a7a5a9773d84145bbf611439d025dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6983c51eda664586ba62e206acfcc2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129349) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:53:38.578709 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-bb3f2929-5fc1-4eac-a781-11f8724be9b5 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] 10.222.0.42 "GET /compute/v2.1/servers/9f9f1452-525b-45a2-b131-5ccbddab15a0" status: 200 len: 1577 microversion: 2.1 time: 0.175907 Jun 06 10:53:38.579407 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 515/1013] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:53:38 2022] GET /compute/v2.1/servers/9f9f1452-525b-45a2-b131-5ccbddab15a0 => generated 1577 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:53:39.597615 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-a3795790-06b7-4456-8595-46af15057f29 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:53:39.598311 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-a3795790-06b7-4456-8595-46af15057f29 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] [instance: 9f9f1452-525b-45a2-b131-5ccbddab15a0] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:53:39.604944 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-a3795790-06b7-4456-8595-46af15057f29 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:53:39.605388 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-a3795790-06b7-4456-8595-46af15057f29 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:53:39.606153 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-a3795790-06b7-4456-8595-46af15057f29 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:53:39.606582 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-a3795790-06b7-4456-8595-46af15057f29 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:53:39.742871 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-a3795790-06b7-4456-8595-46af15057f29 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a7a5a9773d84145bbf611439d025dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6983c51eda664586ba62e206acfcc2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:53:39.750293 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-a3795790-06b7-4456-8595-46af15057f29 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] 10.222.0.42 "GET /compute/v2.1/servers/9f9f1452-525b-45a2-b131-5ccbddab15a0" status: 200 len: 1577 microversion: 2.1 time: 0.156925 Jun 06 10:53:39.750856 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 499/1014] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:53:39 2022] GET /compute/v2.1/servers/9f9f1452-525b-45a2-b131-5ccbddab15a0 => generated 1577 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:53:40.307045 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [req-55eddd21-0d45-4234-8e3b-043acfacbb3c req-fae6bce5-5f1d-4d0b-aed4-2ee7775da0a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f9f1452-525b-45a2-b131-5ccbddab15a0", "name": "network-vif-deleted", "tag": "a5bcd46b-b585-4fa0-966c-9dcec1fda806"}]} {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 10:53:40.315394 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [req-55eddd21-0d45-4234-8e3b-043acfacbb3c req-fae6bce5-5f1d-4d0b-aed4-2ee7775da0a4 service nova] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:53:40.315869 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [req-55eddd21-0d45-4234-8e3b-043acfacbb3c req-fae6bce5-5f1d-4d0b-aed4-2ee7775da0a4 service nova] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:53:40.326877 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.compute.server_external_events [req-55eddd21-0d45-4234-8e3b-043acfacbb3c req-fae6bce5-5f1d-4d0b-aed4-2ee7775da0a4 service nova] Creating event network-vif-deleted:a5bcd46b-b585-4fa0-966c-9dcec1fda806 for instance 9f9f1452-525b-45a2-b131-5ccbddab15a0 on hv-cinder-84482 Jun 06 10:53:40.331750 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [req-55eddd21-0d45-4234-8e3b-043acfacbb3c req-fae6bce5-5f1d-4d0b-aed4-2ee7775da0a4 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029173 Jun 06 10:53:40.332589 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 516/1015] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Jun 6 10:53:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 10:53:40.767270 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-ad0279e4-fbb1-4647-aacc-9e4a1fbb0682 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:53:40.767918 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-ad0279e4-fbb1-4647-aacc-9e4a1fbb0682 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] [instance: 9f9f1452-525b-45a2-b131-5ccbddab15a0] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:53:40.775821 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-ad0279e4-fbb1-4647-aacc-9e4a1fbb0682 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:53:40.775970 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-ad0279e4-fbb1-4647-aacc-9e4a1fbb0682 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:53:40.780666 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-ad0279e4-fbb1-4647-aacc-9e4a1fbb0682 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:53:40.781108 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-ad0279e4-fbb1-4647-aacc-9e4a1fbb0682 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:53:40.819986 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-ad0279e4-fbb1-4647-aacc-9e4a1fbb0682 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:53:40.820725 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-ad0279e4-fbb1-4647-aacc-9e4a1fbb0682 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:53:40.826002 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.objects.instance [None req-ad0279e4-fbb1-4647-aacc-9e4a1fbb0682 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Lazy-loading 'fault' on Instance uuid 9f9f1452-525b-45a2-b131-5ccbddab15a0 {{(pid=129350) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 06 10:53:40.866943 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.policy [None req-ad0279e4-fbb1-4647-aacc-9e4a1fbb0682 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a7a5a9773d84145bbf611439d025dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6983c51eda664586ba62e206acfcc2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129350) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 10:53:40.874825 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-ad0279e4-fbb1-4647-aacc-9e4a1fbb0682 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] 10.222.0.42 "GET /compute/v2.1/servers/9f9f1452-525b-45a2-b131-5ccbddab15a0" status: 200 len: 1185 microversion: 2.1 time: 0.111294 Jun 06 10:53:40.875394 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 500/1016] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:53:40 2022] GET /compute/v2.1/servers/9f9f1452-525b-45a2-b131-5ccbddab15a0 => generated 1185 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 10:53:41.891573 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-d4f94ea9-f304-4be7-97d5-06eda8a2490a tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:53:41.892337 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-d4f94ea9-f304-4be7-97d5-06eda8a2490a tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] [instance: 9f9f1452-525b-45a2-b131-5ccbddab15a0] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:53:41.899330 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-d4f94ea9-f304-4be7-97d5-06eda8a2490a tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:53:41.899831 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-d4f94ea9-f304-4be7-97d5-06eda8a2490a tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:53:41.900598 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-d4f94ea9-f304-4be7-97d5-06eda8a2490a tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:53:41.901037 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-d4f94ea9-f304-4be7-97d5-06eda8a2490a tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:53:41.914077 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.wsgi [None req-d4f94ea9-f304-4be7-97d5-06eda8a2490a tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] HTTP exception thrown: Instance 9f9f1452-525b-45a2-b131-5ccbddab15a0 could not be found. Jun 06 10:53:41.916219 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-d4f94ea9-f304-4be7-97d5-06eda8a2490a tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Request method failure captured: Jun 06 10:53:41.916219 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: request: GET /compute/v2.1/servers/9f9f1452-525b-45a2-b131-5ccbddab15a0 HTTP/1.1 Jun 06 10:53:41.916219 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: Accept: application/json Jun 06 10:53:41.916219 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: Accept-Encoding: identity Jun 06 10:53:41.916219 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: Connection: close Jun 06 10:53:41.916219 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: Content-Length: 0 Jun 06 10:53:41.916219 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: Content-Type: application/json Jun 06 10:53:41.916219 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: Host: 10.222.0.42 Jun 06 10:53:41.916219 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: Openstack-System-Scope: None Jun 06 10:53:41.916219 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: User-Agent: python-urllib3/1.26.9 Jun 06 10:53:41.916219 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Auth-Token: gAAAAABindskOhnFjz92ngoBqEtwV4ZYzw5HwXxT8-fIYoGAXWuY7zBj8RG-thsHVQoTt29dfAjOQHYDE1c8IyyByGVfd2r2g4NhSuRYD6Lz3mVXOff0jPHEwgaN2hAEumoRzE3M76gdLEwLV3xwbgKtkPLU0AEmXGPXp2fXxRNAsDM_YbutL-s Jun 06 10:53:41.916219 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Domain-Id: None Jun 06 10:53:41.916219 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Domain-Name: None Jun 06 10:53:41.916219 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Identity-Status: Confirmed Jun 06 10:53:41.916219 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Is-Admin-Project: True Jun 06 10:53:41.916219 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Project-Domain-Id: default Jun 06 10:53:41.916219 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Project-Domain-Name: Default Jun 06 10:53:41.916219 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Project-Id: 6983c51eda664586ba62e206acfcc2d9 Jun 06 10:53:41.916219 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Project-Name: tempest-TestVolumeBootPattern-1591397316 Jun 06 10:53:41.916219 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Role: member,reader Jun 06 10:53:41.916219 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Roles: member,reader Jun 06 10:53:41.917922 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/6983c51eda664586ba62e206acfcc2d9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/6983c51eda664586ba62e206acfcc2d9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/6983c51eda664586ba62e206acfcc2d9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_6983c51eda664586ba62e206acfcc2d9", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Jun 06 10:53:41.917922 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Tenant: tempest-TestVolumeBootPattern-1591397316 Jun 06 10:53:41.917922 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Tenant-Id: 6983c51eda664586ba62e206acfcc2d9 Jun 06 10:53:41.917922 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Tenant-Name: tempest-TestVolumeBootPattern-1591397316 Jun 06 10:53:41.917922 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-User: tempest-TestVolumeBootPattern-1591397316-project Jun 06 10:53:41.917922 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-User-Domain-Id: default Jun 06 10:53:41.917922 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-User-Domain-Name: Default Jun 06 10:53:41.917922 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-User-Id: 8a7a5a9773d84145bbf611439d025dd8 Jun 06 10:53:41.917922 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-User-Name: tempest-TestVolumeBootPattern-1591397316-project Jun 06 10:53:41.917922 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: method: > Jun 06 10:53:41.917922 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: exception: Instance 9f9f1452-525b-45a2-b131-5ccbddab15a0 could not be found. Jun 06 10:53:41.917922 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: action_args: {'id': '9f9f1452-525b-45a2-b131-5ccbddab15a0'} Jun 06 10:53:41.918954 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 10:53:41.918954 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 10:53:41.918954 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 06 10:53:41.918954 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 06 10:53:41.918954 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 06 10:53:41.918954 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 06 10:53:41.918954 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 06 10:53:41.918954 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 06 10:53:41.918954 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 06 10:53:41.918954 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 06 10:53:41.918954 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9f9f1452-525b-45a2-b131-5ccbddab15a0 could not be found. Jun 06 10:53:41.918954 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Jun 06 10:53:41.918954 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 10:53:41.918954 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Jun 06 10:53:41.918954 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 10:53:41.918954 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 10:53:41.918954 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 10:53:41.918954 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 10:53:41.918954 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 10:53:41.918954 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 10:53:41.920663 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 10:53:41.920663 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 06 10:53:41.920663 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 06 10:53:41.920663 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 06 10:53:41.920663 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 06 10:53:41.920663 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 06 10:53:41.920663 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 06 10:53:41.920663 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9f9f1452-525b-45a2-b131-5ccbddab15a0 could not be found. Jun 06 10:53:41.920663 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Jun 06 10:53:41.920663 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 10:53:41.920663 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Jun 06 10:53:41.920663 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 10:53:41.920663 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 10:53:41.920663 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 10:53:41.920663 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 10:53:41.920663 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 10:53:41.920663 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9f9f1452-525b-45a2-b131-5ccbddab15a0 could not be found. Jun 06 10:53:41.920663 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Jun 06 10:53:41.922071 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-d4f94ea9-f304-4be7-97d5-06eda8a2490a tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Returning 404 to user: Instance 9f9f1452-525b-45a2-b131-5ccbddab15a0 could not be found. {{(pid=129349) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 10:53:41.922071 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-d4f94ea9-f304-4be7-97d5-06eda8a2490a tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] 10.222.0.42 "GET /compute/v2.1/servers/9f9f1452-525b-45a2-b131-5ccbddab15a0" status: 404 len: 111 microversion: 2.1 time: 0.030339 Jun 06 10:53:41.922071 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 517/1017] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:53:41 2022] GET /compute/v2.1/servers/9f9f1452-525b-45a2-b131-5ccbddab15a0 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 06 10:53:42.579601 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-48df0eb3-1792-45a2-a8b0-e744ea9a1ca9 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Calling method '>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:53:42.580154 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.compute.api [None req-48df0eb3-1792-45a2-a8b0-e744ea9a1ca9 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] [instance: 544fc9bb-04f0-453c-a7bb-962f01ed2dd8] Fetching instance by UUID {{(pid=129350) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:53:42.586706 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-48df0eb3-1792-45a2-a8b0-e744ea9a1ca9 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:53:42.587957 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-48df0eb3-1792-45a2-a8b0-e744ea9a1ca9 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:53:42.588721 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-48df0eb3-1792-45a2-a8b0-e744ea9a1ca9 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:53:42.589162 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG oslo_concurrency.lockutils [None req-48df0eb3-1792-45a2-a8b0-e744ea9a1ca9 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:53:42.602025 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.wsgi [None req-48df0eb3-1792-45a2-a8b0-e744ea9a1ca9 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] HTTP exception thrown: Instance 544fc9bb-04f0-453c-a7bb-962f01ed2dd8 could not be found. Jun 06 10:53:42.603632 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-48df0eb3-1792-45a2-a8b0-e744ea9a1ca9 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Request method failure captured: Jun 06 10:53:42.603632 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: request: DELETE /compute/v2.1/servers/544fc9bb-04f0-453c-a7bb-962f01ed2dd8 HTTP/1.1 Jun 06 10:53:42.603632 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: Accept: application/json Jun 06 10:53:42.603632 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: Accept-Encoding: identity Jun 06 10:53:42.603632 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: Connection: close Jun 06 10:53:42.603632 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: Content-Length: 0 Jun 06 10:53:42.603632 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: Content-Type: application/json Jun 06 10:53:42.603632 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: Host: 10.222.0.42 Jun 06 10:53:42.603632 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: Openstack-System-Scope: None Jun 06 10:53:42.603632 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: User-Agent: python-urllib3/1.26.9 Jun 06 10:53:42.603632 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Auth-Token: gAAAAABindskOhnFjz92ngoBqEtwV4ZYzw5HwXxT8-fIYoGAXWuY7zBj8RG-thsHVQoTt29dfAjOQHYDE1c8IyyByGVfd2r2g4NhSuRYD6Lz3mVXOff0jPHEwgaN2hAEumoRzE3M76gdLEwLV3xwbgKtkPLU0AEmXGPXp2fXxRNAsDM_YbutL-s Jun 06 10:53:42.603632 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Domain-Id: None Jun 06 10:53:42.603632 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Domain-Name: None Jun 06 10:53:42.603632 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Identity-Status: Confirmed Jun 06 10:53:42.603632 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Is-Admin-Project: True Jun 06 10:53:42.603632 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Project-Domain-Id: default Jun 06 10:53:42.603632 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Project-Domain-Name: Default Jun 06 10:53:42.603632 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Project-Id: 6983c51eda664586ba62e206acfcc2d9 Jun 06 10:53:42.603632 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Project-Name: tempest-TestVolumeBootPattern-1591397316 Jun 06 10:53:42.603632 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Role: member,reader Jun 06 10:53:42.603632 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Roles: member,reader Jun 06 10:53:42.605289 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/6983c51eda664586ba62e206acfcc2d9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/6983c51eda664586ba62e206acfcc2d9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/6983c51eda664586ba62e206acfcc2d9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_6983c51eda664586ba62e206acfcc2d9", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Jun 06 10:53:42.605289 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Tenant: tempest-TestVolumeBootPattern-1591397316 Jun 06 10:53:42.605289 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Tenant-Id: 6983c51eda664586ba62e206acfcc2d9 Jun 06 10:53:42.605289 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-Tenant-Name: tempest-TestVolumeBootPattern-1591397316 Jun 06 10:53:42.605289 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-User: tempest-TestVolumeBootPattern-1591397316-project Jun 06 10:53:42.605289 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-User-Domain-Id: default Jun 06 10:53:42.605289 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-User-Domain-Name: Default Jun 06 10:53:42.605289 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-User-Id: 8a7a5a9773d84145bbf611439d025dd8 Jun 06 10:53:42.605289 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: X-User-Name: tempest-TestVolumeBootPattern-1591397316-project Jun 06 10:53:42.605289 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: method: > Jun 06 10:53:42.605289 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: exception: Instance 544fc9bb-04f0-453c-a7bb-962f01ed2dd8 could not be found. Jun 06 10:53:42.605289 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: action_args: {'id': '544fc9bb-04f0-453c-a7bb-962f01ed2dd8'} Jun 06 10:53:42.606223 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 10:53:42.606223 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 10:53:42.606223 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 06 10:53:42.606223 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 06 10:53:42.606223 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 06 10:53:42.606223 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 06 10:53:42.606223 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 06 10:53:42.606223 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 06 10:53:42.606223 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 06 10:53:42.606223 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 06 10:53:42.606223 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 544fc9bb-04f0-453c-a7bb-962f01ed2dd8 could not be found. Jun 06 10:53:42.606223 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi Jun 06 10:53:42.606223 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 10:53:42.606223 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi Jun 06 10:53:42.606223 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 10:53:42.606223 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 10:53:42.606223 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 10:53:42.606223 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 10:53:42.606223 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 10:53:42.606223 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 10:53:42.607799 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 10:53:42.607799 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 06 10:53:42.607799 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 06 10:53:42.607799 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 06 10:53:42.607799 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 06 10:53:42.607799 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 06 10:53:42.607799 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 06 10:53:42.607799 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 06 10:53:42.607799 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 06 10:53:42.607799 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 544fc9bb-04f0-453c-a7bb-962f01ed2dd8 could not be found. Jun 06 10:53:42.607799 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi Jun 06 10:53:42.607799 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 10:53:42.607799 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi Jun 06 10:53:42.607799 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 10:53:42.607799 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 10:53:42.607799 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 10:53:42.607799 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 10:53:42.607799 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 10:53:42.607799 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 544fc9bb-04f0-453c-a7bb-962f01ed2dd8 could not be found. Jun 06 10:53:42.607799 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: ERROR nova.api.openstack.wsgi Jun 06 10:53:42.609663 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-48df0eb3-1792-45a2-a8b0-e744ea9a1ca9 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Returning 404 to user: Instance 544fc9bb-04f0-453c-a7bb-962f01ed2dd8 could not be found. {{(pid=129350) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 10:53:42.609663 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-48df0eb3-1792-45a2-a8b0-e744ea9a1ca9 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] 10.222.0.42 "DELETE /compute/v2.1/servers/544fc9bb-04f0-453c-a7bb-962f01ed2dd8" status: 404 len: 111 microversion: 2.1 time: 0.029485 Jun 06 10:53:42.609663 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 501/1018] 10.222.0.42 () {58 vars in 1238 bytes} [Mon Jun 6 10:53:42 2022] DELETE /compute/v2.1/servers/544fc9bb-04f0-453c-a7bb-962f01ed2dd8 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 06 10:53:42.613517 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-536949c8-6095-4a8c-90b7-07cc988ceb56 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Calling method '>' {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:53:42.614164 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.compute.api [None req-536949c8-6095-4a8c-90b7-07cc988ceb56 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] [instance: 544fc9bb-04f0-453c-a7bb-962f01ed2dd8] Fetching instance by UUID {{(pid=129349) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 10:53:42.620447 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-536949c8-6095-4a8c-90b7-07cc988ceb56 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:53:42.620889 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-536949c8-6095-4a8c-90b7-07cc988ceb56 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:53:42.621651 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-536949c8-6095-4a8c-90b7-07cc988ceb56 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 10:53:42.622084 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG oslo_concurrency.lockutils [None req-536949c8-6095-4a8c-90b7-07cc988ceb56 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Lock "b2cac780-caea-4a39-b7a4-6bc4960cc6e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 10:53:42.635712 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.wsgi [None req-536949c8-6095-4a8c-90b7-07cc988ceb56 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] HTTP exception thrown: Instance 544fc9bb-04f0-453c-a7bb-962f01ed2dd8 could not be found. Jun 06 10:53:42.637225 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-536949c8-6095-4a8c-90b7-07cc988ceb56 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Request method failure captured: Jun 06 10:53:42.637225 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: request: GET /compute/v2.1/servers/544fc9bb-04f0-453c-a7bb-962f01ed2dd8 HTTP/1.1 Jun 06 10:53:42.637225 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: Accept: application/json Jun 06 10:53:42.637225 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: Accept-Encoding: identity Jun 06 10:53:42.637225 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: Connection: close Jun 06 10:53:42.637225 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: Content-Length: 0 Jun 06 10:53:42.637225 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: Content-Type: application/json Jun 06 10:53:42.637225 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: Host: 10.222.0.42 Jun 06 10:53:42.637225 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: Openstack-System-Scope: None Jun 06 10:53:42.637225 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: User-Agent: python-urllib3/1.26.9 Jun 06 10:53:42.637225 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Auth-Token: gAAAAABindskOhnFjz92ngoBqEtwV4ZYzw5HwXxT8-fIYoGAXWuY7zBj8RG-thsHVQoTt29dfAjOQHYDE1c8IyyByGVfd2r2g4NhSuRYD6Lz3mVXOff0jPHEwgaN2hAEumoRzE3M76gdLEwLV3xwbgKtkPLU0AEmXGPXp2fXxRNAsDM_YbutL-s Jun 06 10:53:42.637225 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Domain-Id: None Jun 06 10:53:42.637225 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Domain-Name: None Jun 06 10:53:42.637225 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Identity-Status: Confirmed Jun 06 10:53:42.637225 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Is-Admin-Project: True Jun 06 10:53:42.637225 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Project-Domain-Id: default Jun 06 10:53:42.637225 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Project-Domain-Name: Default Jun 06 10:53:42.637225 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Project-Id: 6983c51eda664586ba62e206acfcc2d9 Jun 06 10:53:42.637225 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Project-Name: tempest-TestVolumeBootPattern-1591397316 Jun 06 10:53:42.637225 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Role: member,reader Jun 06 10:53:42.637225 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Roles: member,reader Jun 06 10:53:42.638838 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/6983c51eda664586ba62e206acfcc2d9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/6983c51eda664586ba62e206acfcc2d9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/6983c51eda664586ba62e206acfcc2d9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_6983c51eda664586ba62e206acfcc2d9", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Jun 06 10:53:42.638838 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Tenant: tempest-TestVolumeBootPattern-1591397316 Jun 06 10:53:42.638838 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Tenant-Id: 6983c51eda664586ba62e206acfcc2d9 Jun 06 10:53:42.638838 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-Tenant-Name: tempest-TestVolumeBootPattern-1591397316 Jun 06 10:53:42.638838 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-User: tempest-TestVolumeBootPattern-1591397316-project Jun 06 10:53:42.638838 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-User-Domain-Id: default Jun 06 10:53:42.638838 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-User-Domain-Name: Default Jun 06 10:53:42.638838 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-User-Id: 8a7a5a9773d84145bbf611439d025dd8 Jun 06 10:53:42.638838 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: X-User-Name: tempest-TestVolumeBootPattern-1591397316-project Jun 06 10:53:42.638838 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: method: > Jun 06 10:53:42.638838 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: exception: Instance 544fc9bb-04f0-453c-a7bb-962f01ed2dd8 could not be found. Jun 06 10:53:42.638838 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: action_args: {'id': '544fc9bb-04f0-453c-a7bb-962f01ed2dd8'} Jun 06 10:53:42.639754 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: {{(pid=129349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 10:53:42.639754 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 10:53:42.639754 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 06 10:53:42.639754 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 06 10:53:42.639754 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 06 10:53:42.639754 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 06 10:53:42.639754 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 06 10:53:42.639754 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 06 10:53:42.639754 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 06 10:53:42.639754 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 06 10:53:42.639754 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 544fc9bb-04f0-453c-a7bb-962f01ed2dd8 could not be found. Jun 06 10:53:42.639754 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Jun 06 10:53:42.639754 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 10:53:42.639754 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Jun 06 10:53:42.639754 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 10:53:42.639754 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 10:53:42.639754 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 10:53:42.639754 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 10:53:42.639754 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 10:53:42.639754 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 10:53:42.641338 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 10:53:42.641338 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 06 10:53:42.641338 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 06 10:53:42.641338 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 06 10:53:42.641338 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 06 10:53:42.641338 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 06 10:53:42.641338 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 06 10:53:42.641338 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 544fc9bb-04f0-453c-a7bb-962f01ed2dd8 could not be found. Jun 06 10:53:42.641338 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Jun 06 10:53:42.641338 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 10:53:42.641338 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Jun 06 10:53:42.641338 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 10:53:42.641338 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 10:53:42.641338 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 10:53:42.641338 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 10:53:42.641338 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 10:53:42.641338 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 544fc9bb-04f0-453c-a7bb-962f01ed2dd8 could not be found. Jun 06 10:53:42.641338 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: ERROR nova.api.openstack.wsgi Jun 06 10:53:42.642702 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: DEBUG nova.api.openstack.wsgi [None req-536949c8-6095-4a8c-90b7-07cc988ceb56 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Returning 404 to user: Instance 544fc9bb-04f0-453c-a7bb-962f01ed2dd8 could not be found. {{(pid=129349) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 10:53:42.642702 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO nova.api.openstack.requestlog [None req-536949c8-6095-4a8c-90b7-07cc988ceb56 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] 10.222.0.42 "GET /compute/v2.1/servers/544fc9bb-04f0-453c-a7bb-962f01ed2dd8" status: 404 len: 111 microversion: 2.1 time: 0.028858 Jun 06 10:53:42.642702 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: [pid: 129349|app: 0|req: 518/1019] 10.222.0.42 () {58 vars in 1235 bytes} [Mon Jun 6 10:53:42 2022] GET /compute/v2.1/servers/544fc9bb-04f0-453c-a7bb-962f01ed2dd8 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 06 10:53:43.924823 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: DEBUG nova.api.openstack.wsgi [None req-fb01d131-b42c-4eff-b09d-9283b8fb5c11 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] Calling method '.version_select at 0x7f8fd829c4c0>' {{(pid=129350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 10:53:43.957043 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO nova.api.openstack.requestlog [None req-fb01d131-b42c-4eff-b09d-9283b8fb5c11 tempest-TestVolumeBootPattern-1591397316 tempest-TestVolumeBootPattern-1591397316-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1544406201" status: 202 len: 0 microversion: 2.1 time: 0.035950 Jun 06 10:53:43.957628 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: [pid: 129350|app: 0|req: 502/1020] 10.222.0.42 () {58 vars in 1262 bytes} [Mon Jun 6 10:53:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1544406201 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 06 10:54:47.887736 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 06 10:54:47.888556 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: Mon Jun 6 10:54:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 06 10:56:34.726099 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 06 10:56:34.726799 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: Mon Jun 6 10:56:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 06 10:56:42.651031 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 06 10:56:42.651622 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: Mon Jun 6 10:56:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 06 10:56:48.580706 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 06 10:56:48.581287 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: Mon Jun 6 10:56:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 06 10:56:52.382877 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 06 10:56:52.383516 dv-cinder-844822-1-iscsi devstack@n-api.service[129349]: Mon Jun 6 10:56:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 06 10:56:56.122677 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 06 10:56:56.123281 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: Mon Jun 6 10:56:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 06 10:58:07.897152 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 06 10:58:07.898319 dv-cinder-844822-1-iscsi devstack@n-api.service[129350]: Mon Jun 6 10:58:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!